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OPTIMAL  RESOURCE  ALLOCATION  FOR  A  CONTROLLER 
WITH  TWO  RESOURCE  TYPES 


Introduction 


In  this  thesis,  the  problem  of  allocating  the  defensive  resources  of  a  target 
under  attack  so  as  to  maximize  the  probability  of  target  survival  is  considered. 
A  certain  number  of  attackers  arrive  in  a  finite  time  horizon  [0,0],  each  with 
the  goal  of  hitting  the  target.  The  target  is  equipped  with  various  defensive 
resources  to  counter  the  attacks.  Whether  or  not  the  target  survives  depends 
on  the  success  of  the  countermeasures.  Combinatorial  algorithms  are  developed 
for  determining  the  optimal  allocation  schemes  under  deterministic,  minimax, 
and  Bayesian  formulations,  when  the  arrival  times  and  arrival  tingles  of  the 
attackers  are  known  a  priori,  and  in  the  minimax  formulation,  when  they  are  not. 
A  neural  network  is  developed  for  determining  the  optimal  allocation  scheme 
under  a  deterministic  formulation  when  the  arrival  times  and  arrival  angles  of 
the  attackers  are  known  a  priori. 

Manuscript  approved  September  9,  1989. 
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The  model  used  in  the  analysis  makes  four  assumptions.  The  first  assumption 
is  that  the  target  is  stationary.  This  assumption  simplifies  the  dynaimics  of  the 
system.  As  will  be  seen  in  Chapter  1,  among  other  variables,  the  probability  of 
target  survival  is  dependent  upon  the  physical  location  of  the  attacker  relative 
to  the  target.  If  the  target  is  allowed  to  move,  the  probability  of  target  survival 
then  depends  on  its  trajectory.  Restricting  its  motion  eliminates  that  time 
dependency  from  the  expression  for  the  probability  of  target  survival.  Also  if 
the  target  was  allowed  to  move,  its  velocity  would  be  much  less  than  the  velocity 
of  the  attackers,  so  this  assumption  is  not  unreasonable. 

The  second  assumption  is  that  there  is  only  one  type  of  attacker.  This 
assumption  simplifies  the  modeling  of  the  problem,  and  also  simplifies  the  cost 
function  by  removing  any  dependency  on  attacker  type. 

The  third  assumption  is  that  the  only  defensive  resources  available  to  the 
target  are  decoys  and  a  hardkill  system.  No  generality  is  lost  by  this  assumption. 

The  fourth  assumption  is  that  the  target  survives  only  if  none  of  the  attackers 
that  arrive  in  [0,0]  hit  it.  As  will  be  shown  in  Chapter  1,  this  assumption  is  the 
foundation  of  the  cost  function,  and  results  in  the  determination  of  the  allocation 
schemes  with  the  highest  probability  of  the  target  sustaining  no  hits. 

The  remainder  of  this  introduction  describes  the  physical  model  in  more 
detail  beginning  with  the  characteristics  of  the  attackers,  then  an  explanation 
of  the  operation  and  application  of  the  countermeasures. 

The  environment  is  considered  to  be  a  plane,  with  the  center  of  the  target 
at  the  origin.  All  attackers  arrive  at  an  initial  range  of  from  the  target, 
and  at  an  initial  angle  in  one  of  M  sectors.  The  sectors  are  denoted  by  5/  for 
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/=l,.--,Af.  The  attackers  operate  by  sampling  a  region  of  the  environment,  and 
then  traveling  with  velocity  towards  the  center  of  mass  of  the  distribution 
of  returned  energy  from  the  objects  contained  inside  the  region.  This  is  known 
as  tracking.  The  sampling  region  is  called  the  range  gate  of  the  attacker.  The 
attackers  can  only  track  objects  that  are  inside  their  range  gates. 

The  range  gate  width  is  divided  into  two  segments:  the  early-gate  segment 
and  the  late-gate  segment.  If  the  attacker  first  amplifies  the  energy  in  the  early- 
gate  segment,  then  centroids  on  the  distribution  of  energy  in  the  whole  gate, 
it  is  employing  leading-edge  tracking  [LE).  If  the  attacker  centroids  on  the 
distribution  of  energy  in  the  whole  gate,  treating  both  segments  equally,  it  is 
employing  centroiding  tracking  (CEN). 

The  attackers  cannot  alternate  between  tracking  techniques,  this  parameter 
is  fixed  for  each  attacker. 

An  attacker  is  either  in  the  tracking  state  (T),  in  which  it  is  tracking  the 
target,  or  in  the  not-tracking  state  (T),  in  which  it  is  not  tracking  the  target. 
After  a  certain  amount  of  time  //y  since  a  pju'ticular  attacker’s  arrival,  it  will 
become  known  to  the  target  which  state  the  attacker  is  in.  Upon  sirrival  and 
during  the  period  pr,  it  is  assumed  the  attacker  is  in  the  tracking  state.  If  an 
attacker  transitions  from  the  tracking  state  into  the  not-tracking  state,  it  cannot 
re-enter  the  tracking  state.  If  an  attacker  never  transitions  out  of  the  tracking 
state,  it  will  hit  the  target  /ip  =  ^  time  units  after  its  arrived. 

Each  attacker  at  time  t  is  characterized  by  the  following  parameters: 

range  from  the  target  r(t)  6  T^'*' 
atngle  from  the  target  0(t)  6  {Si,. ..,5a/} 
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tracking  state  ^(/)  €  {T,T) 

tracking  technique  a  6  {LE,CEN) 
arrival  time  t  €  [0,  fi]. 

The  state  vector  describing  the  the  attacker  at  time  t  is  given  by: 

The  target  may  or  may  not  have  knowledge  of  the  tracking  technique  of  the 
attackers.  When  the  tracking  techniques  are  not  known,  an  a  priori  probability 
distribution  describing  the  tracking  method  may  be  available.  This  distribution 
is  given  by; 

Pr(a  =  LE)  =  p 
Pr{a  =  CEN)  =  1  -  p, 

and  it  is  assumed  the  tracking  method  of  one  attacker  does  not  depend  on 
the  tracking  method  of  any  other  attacker.  Also  the  target  may  be  provided 
with  periodic  updates  of  the  range,  angle,  and  tracking  state  of  each  attacker. 
The  arrival  times  and  zu-riveil  angles  of  the  attackers  may  or  may  not  be  known 
a  priori.  If  the  arrival  schedule  is  not  known  in  advance,  it  is  assumed  the 
attackers  arrive  independently  of  each  other  according  to  a  Poisson  process  with 
stationary  arrival  rate  A,  and  with  an  equal  probability  of  arriving  from  any  one 
of  the  M  angle  sectors. 

The  target  has  three  countermeasures  it  can  apply  to  protect  itself  from  the 
attackers.  The  first  two  countermeasures  are  decoys  and  the  third  is  a  hardkill 
system.  A  countermeasure  is  successful  against  an  attacker  if  it  causes  the 
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attacker  to  transition  from  T  to  T.  Since  an  attacker  cannot  transition  back  to 
the  T  state  once  it  has  entered  the  T  state,  a  countermeasure  can  succeed  against 
a  particular  attacker  only  if  all  the  countermeasures  applied  earlier  failed. 

There  are  a  total  of  Dl  decoys  of  type  X,  and  Dn  decoys  of  type  R  available 
to  the  target.  Deployed  decoys  are  the  only  objects  in  the  environment  for  the 
attackers  to  track  other  than  the  target.  Both  decoy  types  operate  by  entering 
the  range  gate  of  an  attacker,  then  traveling  through  it  with  velocity  vd  <. 
away  from  the  target.  The  attacker  tries  to  distinguish  between  the  target 
and  the  decoy.  If  the  decoy  is  successful,  the  attacker  will  track  the  decoy's 
motion  instead  of  tracking  the  target.  The  attacker’s  range  gate  will  move  with 
the  decoy,  and  since  the  decoy  is  traveling  away  from  the  target,  the  target  will 
eventually  be  outside  the  range  gate.  The  attacker  will  therefore  miss  the  target. 
This  is  known  as  range  gate  pull  oil. 

All  objects  inside  the  range  gate  of  an  att£u:ker  influence  its  decision  on  which 
object  is  the  true  target,  however  the  attacker  must  ultimately  choose  only  one 
object  to  track.  In  other  words,  the  attacker’s  range  gate  cannot  follow  more 
than  one  decoy.  Hence  a  decoy  can  succeed  in  causing  an  attacker  to  track  it 
only  if  all  the  decoys  deployed  earlier  failed. 

Decoys  cannot  succeed  against  any  attacker  whose  range  is  within  a  radius 
^  from  the  target.  Every  time  the  target  deploys  either  type  of  decoy, 
each  one  is  placed  in  the  same  physical  location  with  respect  to  the  target,  with 
the  location  for  the  type  L  decoys  different  from  that  for  the  type  R  decoys.  It 
is  assumed  that  when  a  decoy  is  deployed,  it  will  be  contained  inside  the  range 
gate  of  any  attacker  that  is  presently  tracking  the  target  with  a  range  greater 
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than  ro-  The  decoy  is  also  contained  inside  the  rainge  gale  of  any  attacker  that 
arrives  within  fip  time  units  after  the  deployment. 

There  must  be  a  delay  of  Ad  time  units  between  deploying  decoys  of  the 
either  type.  This  is  to  prevent  the  decoys  from  stacking  on  top  of  each  other, 
as  stacked  decoys  are  not  better  at  pulling  the  range  gate  of  an  attacker  off  the 
target  than  single  decoys. 

The  third  countermeasure  is  a  hardkill  system.  There  are  a  total  of  B  units 
of  this  resource  available  to  the  target.  One  unit  is  used  each  time  the  system 
is  employed.  The  target  operates  this  system  by  directing  it  toward  a  specific 
attacker  and  firing.  If  the  system  is  successful,  the  attacker  will  immediately  stop 
tracking  the  target.  The  target  is  then  alerted  of  the  change  in  the  attacker’s 
state.  The  system  has  a  maximum  range  of  rg  <  r^),  outside  of  which  it  is 
totally  ineffective.  The  target  must  wait  Ag  time  units  after  using  the  hardkill 
system  before  using  it  again.  This  countermeasure  is  denoted  by  G,,  where  the 
subscript  i  signifies  which  attacker  the  h<irdkill  system  is  directed  towau'd. 

When  the  attackers  arrive,  and  until  it  is  known  otherwse,  they  are  assumed 
to  travel  radial  trajectories  toward  the  target  given  by: 

r(0  =  -  vyiit  -  t);  T  -  <  t  <r  +  fin 

e{t)  =  0{Ty,  T  -  ftp  <  t  <  T  +  fin. 

An  attacker  will  only  veer  from  this  trajectory  if  a  countermeasure  hats  caused 
it  to  enter  the  not-tracking  state. 

The  time  interval  [0,n]  is  broken  into  decision  instants.  The  decision  instants 
are  the  only  times  at  which  the  target  can  apply  countermeasures.  If  updates  of 
the  states  of  the  attackers  are  available,  they  will  be  provided  at  each  decision 
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instant.  There  is  a  decision  instant  every  A  time  units  starting  at  time  0, 
resulting  in  a  total  of  K  =  [£j  decision  instants.  The  times  Ad  and  Ab  are 
both  multiples  of  A.  The  decision  instant  occurs  at  time  t*.  A  decoy  of  type 
L  or  of  type  /?  is  a  feasible  countermeasure  at  the  decision  instant  if  tk  does 
not  occur  during  the  period  Ad  after  the  most  recent  deployment  of  a  decoy, 
and  there  is  either  at  least  one  attacker  present  with  range  greater  than  r£j,  or  at 
least  one  attacker  known  to  have  an  arrival  time  in  the  interval  [ik,tk  +  /X£»].  Also 
the  supply  of  decoys  must  not  be  exhausted.  The  hardkill  system  is  a  feeisible 
countermeasure  at  the  decision  instant  if  tk  does  not  occur  during  the  period 
Ab  after  the  last  use  of  the  system,  and  there  is  at  least  one  attacker  with  range 
less  than  r^.  Also  the  supply  of  resource  used  by  the  hardkill  system  must  not 
be  exhausted. 

Let  Uk  denote  the  set  of  feasible  countermeasures  or  controls  at  the  jb*** 
decision  instant.  All  sets  include  a  “do  nothing”  control,  which  is  denoted  by  Z. 
At  time  tk  the  target  chooses  to  apply  one  emd  only  one  countermeasure  from 
Uk. 

Let  Uk  denote  the  countermeasure  or  control  to  apply  at  the  decision 
instant,  where  Uk  6  Uk,  and  let  uk=(u\,ui,  ...,ui^)  be  the  allocation  scheme,  or 
control  vector,  for  K  decision  instants. 

It  is  desired  to  determine  the  allocation  scheme,  or  the  control  vector,  that 
maocimizes  the  target’s  probability  of  survival.  In  this  thesis,  combinatorial  al¬ 
gorithms  are  developed  for  determining  the  optimal  schemes  \mder  various  con¬ 
ditions.  UTien  the  arrival  times  and  arrival  angles  of  the  attackers  are  known  a 
priori,  an  exhaustive  search  and  a  trimmed  search  are  developed  for  determining 
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the  optimal  allocation  schemes  under  a  deterministic  formulation,  in  which  the 
tracking  methods  of  the  attackers  are  known  a  priori;  under  a  minimax  formula¬ 
tion  in  which  the  tracking  methods  are  never  known  to  the  target,  and  there  is 
no  prior  probability  distribution  available  describing  this  parameter;  and  under 
a  Bayesian  formulation,  in  which  the  tracking  methods  are  again  unknown,  but 
there  is  a  prior  probability  distribution  available  describing  the  tracking  method. 
In  the  minimax  formulation,  the  trimmed  search  is  applied  to  determine  the  op¬ 
timal  allocation  schemes  when  the  arrival  times  are  not  known  a  priori.  A  neural 
network  of  the  type  applied  to  the  Traveling  Salesman  Problem  by  Hopfield  and 
Tank  (1],  is  developed  for  obtaining  the  optimal  allocation  scheme  in  the  deter¬ 
ministic  formulation,  when  the  arrival  times  and  arrival  angles  of  each  attacker 
are  known  a  priori.  In  Chapter  1  the  probability  of  target  survival  is  derived. 
In  the  remaining  chapters,  the  algorithms  sire  described.  The  efficiency  with 
which  each  algorithm  arrives  at  a  solution,  and  the  ability  of  each  algorithm  to 
determine  the  optimal  control  sequence  are  discussed.  Numerical  results  from 
applying  the  algorithms  to  specific  attack  situations  are  given  in  Chapter  5. 


Chapter  1 

Derivation  of  Cost  Function 


As  stated  in  the  introduction,  the  objective  of  each  algorithm  is  to  deter¬ 
mine  the  sequence  of  countermeasures  that  maximizes  the  probability  of  target 
survival.  From  the  fourth  model  assumption,  the  target  survives  only  if  none 
of  the  attackers  arriving  in  [0,0]  hit  it.  Whether  or  not  an  attacker  hits  the 
target  depends  on  the  success  of  the  countermeasures  applied  by  the  target.  For 
each  countermeasure,  there  is  a  probability  distribution  describing  its  success 
in  causing  an  attacker  to  transition  from  T"  to  T,  as  a  function  of  the  time  the 
countermeasure  is  applied,  and  the  state  vector  of  the  attacker  at  the  time  of 
the  application. 
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Since  a  countermeasure  can  succeed  in  causing  an  attacker  to  transition  from 
the  tracking  state  into  the  not-tracking  state  only  if  all  the  countermeasures 
applied  earlier  failed,  the  probability  of  success  of  a  countermeasure  against 
an  attacker  is  zero  if  the  attacker  is  in  the  not-tracking  state  at  the  time  the 
countermeasure  is  applied.  It  is  also  zero  if  the  countermeasure  is  applied  after 
time  T  fiQ,  where  t  is  the  attacker’s  arrival  time. 

The  probability  of  success  of  a  type  L  decoy  deployed  at  time  tk  against  the 
t*'’  attacker,  assuming  all  countermeasures  applied  previous  to  tk  failed,  is  given 
by 

PL(ri(tk),  Siiik),  Qi,  Ti,  tk)- 

Similarly,  the  probability  of  success  of  a  type  R  decoy  deployed  at  time  ik  against 
the  attacker,  assuming  all  countermeasures  applied  previous  to  ik  failed,  is 
given  by 

Of.,  Ti,  ffc). 

Unlike  the  decoys,  the  target  must  direct  the  hardkill  system  toward  a  spo<:ific 
attacker.  The  probability  of  success  of  the  system  is  nonzero  only  for  the  attai  ^  er 
it  is  aimed  at;  it  is  zero  for  all  other  attackers.  The  probability  of  success  -f 
the  hardkill  system  directed  toward  the  attacker  at  time  <*,  assuming  all 
countermeasures  applied  previous  to  ik  failed,  is  given  by 

PG(ri(ik)y^,(ik),T„tk). 

All  three  of  the  above  distributions  are  known. 

Since  the  probability  distribution  describing  the  success  of  the  hardkill  sys¬ 
tem  does  not  depend  on  the  attacker  state  parameters  q  and  ^(t),  they  can 
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be  included  as  parameters  of  the  distribution  without  changing  its  shape.  This 
gives  the  probability  of  success  of  the  hardkill  system  directed  toward  the  i‘'‘ 
attacker  at  time  f/t,  assuming  all  countermeasures  applied  previous  to  failed, 
as 


Pciriitk),  ffi(tk),  A(ffc),  Om  Ti,  tk). 

Since  the  three  distributions  describing  the  success  of  the  countermeasiires 
all  depend  on  the  same  variables,  one  distribution  can  be  defined  that  describes 
the  probability  of  success  of  a  countermeasure  as  a  function  of  the  applied  coun¬ 
termeasure,  the  time  of  the  application,  and  the  state  vector  of  the  attacker  at 
the  time  of  the  application. 

Define  the  following  two  events: 

Sj  :  Countermeasure  applied  at  time  tj  caused  the  attacker  to  transition 
from  T  to  T 

Fj  :  Countermeasure  applied  at  time  tj  failed  to  cause  the  attacker  to  tran¬ 
sition  from  T  to  T. 

The  probability  of  success  of  a  countermeasure  u*  against  the  attacker  at  time 
tk,  assuming  all  countermeasures  applied  previous  to  tk  failed,  is  then  given  by 

/*r(Sfc|Ffc_,...Fi)  =  Piri{tk),9i{tk),0i{tk),Qi,Ti,tk,Uk).  (1.1) 

For  notational  convenience,  the  above  distribution  will  be  represented  by 

Pr(s;|F;.,...Fi)  = 
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1.1  Known  Arrival  Times 

Suppose  the  arrival  times  and  the  arrival  angles  of  the  attackers  au-e  known 
to  the  target  a  priori.  This  means  the  total  number  of  attackers  will  be  known. 
Let  n  be  the  number  of  attackers  arriving  in  [0,^].  Define  the  following  two 
events: 


M,-  :  The  attacker  misses  the  target 
H,  :  The  attacker  hits  the  target. 

The  probability  of  target  survival  is  written  as 
/*r(Target  survival) 

=  Pr(None  of  the  n  attackers  hit  the  target) 

=  Pr(All  n  attackers  miss  the  target) 

=  Pr(Miss) 

=  Pr(M,  nM2n...nM„).  (1.2) 

The  success  or  faulure  of  an  attacker  in  hitting  the  target  may  affect  the 
chances  of  the  other  attackers.  Therefore,  it  cannot  be  assumed  that  the  events 
Ml,  M2, ...,  M„  are  independent.  Hence, 

Pr(Miss)  =  Pr(Mi  nM2n...nM„) 

=  Pr(M„|M„_i...M,)Pr(M„_,|M„_2...M,)...Pr(M,) 

=  nPr(M.|M._,...M,) 

i=l 
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(1.3) 


=  nil  - 

<=I 

Now  a  hit  by  an  attacker  occurs  if  the  attacker  remains  in  the  tracking  state 
during  the  period  [t,  t  +  /in],  where  t  is  the  attacker’s  arrival  time.  There  ao-e 
two  ways  in  which  this  can  happen.  The  first  way  is  if  no  counter- action  is  taken 
by  the  target  agadnst  the  attacker  during  [r,  r  +  fin]-  Recall  that  am  attacker  is 
tracking  the  target  upon  arrivad.  If  the  tau'get  tadces  no  defensive  measures,  the 
attacker  will  continue  tracking  it. 

The  second  way  an  attacker  will  remain  in  the  tracking  state  is  if  all  the 
counter-actions  taiken  by  the  tairget  during  the  time  [t,  t  -|-  /in]  fail  to  cause  the 
attacker  to  transition  into  the  not-tracking  state. 

The  probability  of  a  hit  by  the  attacker,  assuming  the  t-1  attackers  ar¬ 
riving  before  t,  each  missed  the  target,  is  given  by 

Pr(H.|M..,...M,)  «  Pr(F;  n  Fj‘ n ...  n 


k=l 

=  flii-.p:.('*)i, 

k=l 

w’here  K  is  the  total  number  of  decision  instants  in  [0,11]. 

The  probability  of  target  survival  given  in  (1.3)  then  becomes 

Fr(Miss)  =  J][[l  -  Fr(H,|M,_i...,^/i)] 


(1.4) 


=  n(i- ('-5) 

1=1  k=l 

The  above  expression  for  the  probability  of  target  sunival  can  be  written  in 
a  second  form.  An  attacker  will  miss  the  target  if  one  of  the  countermeasure 
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applied  in  (r,  T  +  /in]  causes  the  attacker  to  transition  into  the  not-tracking  state. 
The  probability  of  a  miss  by  the  attacker,  assuming  the  i-1  attackers  arriving 
before  t,  each  missed  the  target,  is  therefore  given  by 


=  Pr{S\^Fk.,...Fi)  +  ...  +  PriS'^Fi)  +  Pr(5;) 

=  (<*)).-(l  -  PtAik))]  + ... 

+K{h){l-PUt,))]  +  Pi^it,) 

=  E  -  p:,M) 

k=l  /=! 

=  -<(<*))•  (1.6) 

kssl  t=l 

Using  (1.6),  the  probability  of  target  survival  in  (1.3)  can  also  be  expressed 
as 


Pr(Miss)  =  n^’‘(M.|M.-i...A/i) 

1=1 

=  nEn^w(<*)(i -<('*)))■  (1.7) 

i=i  t=i  /=i 

Since  the  events  M,  and  H,  exhaust  the  sample  space,  (1.4)  and  (1.6)  can  be 
combined  to  yield  the  following  relationship: 

En<(W(i-i’;(<.))+ni>-.pi.('‘))  =  '•  (1.8) 

*=1  1=1  k=\ 


1.2  Unknown  Arrival  Times 


Now  suppose  neither  the  arrival  times  nor  the  arrival  angles  of  the  attackers 
are  known  to  the  target  a  priori.  The  number  of  attackers  arriving  in  [0,fl]  is 
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therefore  not  known.  The  attackers  arrive  according  to  a  Poisson  process  with 
stationary  arrival  rate  The  expected  number  of  attackers,  n,  arriving  in  [0,n] 
is  Afl.  The  probability  that  exactly  m  attackers  arrive  in  [0,n]  is  given  by 


Pr{n  =  m)  = 


(An^c 


m  _  — AtJ 


Using  the  principle  of  total  probability,  the  probability  of  target  survival 


becomes 


Pr(Miss)  =  -^K^^jssln  =  m)Pr{n  =  m). 


The  quantity  Pr(Miss|n  =  m)  is  given  by  (1.3)  with  n=m,  that  is 

m 

Pr(Missln  =  m)  =  PJ[1  —  Pr(Hi|M<_i,..Mi)]. 

isl 

Hence,  the  probability  of  target  survival  can  be  written  as 

OO 

Pr(Miss)  =  -P^CMlssln  =  m)Pr(n  =  m) 

m=0 

=  E  - ni>  - 


=  L 


c  ^  1,  nil  -  IK' 


•=i  fc=i 


Using  the  relationship  in  Equation  (8),  this  can  also  be  written  as 


Pr(Miss)  = 


(Afi)"*c 


(1.10) 


-An  m  K  fc-1 

— niE  n  <(^0(1  -  p^ih))].  (1.11) 

k=\  /=i 


Two  expressions  of  the  cost  function  as  the  probability  of  target  survival 
have  now  been  derived  for  both  the  case  of  known  attacker  arrival  times  and 
arrival  angles,  and  the  case  of  unknown  attacker  arrival  times.  The  form  used 
depends  on  the  attacker  arrival  information  available  to  the  target,  and  on  which 
algorithm  is  being  applied  to  find  the  optimal  sequence  of  countermeasures. 
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Chapter  2 


Known  Arrival  Times 


Suppose  the  attacker  arrival  times  and  arrival  angles  are  known  to  the 
target  a  priori.  Let  n  be  the  total  number  of  attackers  arriving  in  [0,n]  such 
that  0  <  Ti  <  ...  <  T„  <  n. 

The  time  interval  [0,0]  can  be  defined  in  terms  of  the  arrival  times  of  the 
first  and  n**  attackers.  Recall  from  the  introduction,  that  a  decoy  deployed 
at  time  t  can  affect  the  tracking  state  of  any  attacker  whose  range  from  the 
target  at  time  t  is  greater  than  rp,  including  any  attacker  that  arrives  within 
fip  time  units  after  the  deployment.  Therefore  time  0  can  be  defined  as  —  fip. 
The  target  has  fin  time  units  after  an  attacker’s  arrival  in  which  to  counter  its 
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attack.  The  time  can  therefore  be  defined  as  r„  +  /in-  The  time  interval  [0,0] 
is  then  given  by  [ti  —  ’’n  +  /^o],  and  the  total  number  of  decision  instants  is 

_  j^Tn-Ti.^B+tin  j 

As  defined  earlier,  uk  —  (ui,...,Uf;)  is  the  allocation  scheme,  or  control 
vector,  for  K  decision  instants,  where  uj  6  Uk  is  the  countermeasure,  or  control, 
to  apply  at  the  decision  instant,  and  Uk  is  the  set  of  countermeasures,  or 
controls,  feasible  at  time  tk- 


2.1  States  Updates  Unavailable 

In  each  of  the  three  formulations,  in  order  to  determine  the  optimal  alloca¬ 
tion  scheme  for  a  given  set  of  arrival  times  and  arrival  angles,  a  set  of  feasible 
allocation  schemes,  or  feasible  control  vectors,  must  be  defined.  It  is  necessary 
to  know  the  states  of  the  attackers  at  each  decision  instant,  and  the  previously 
applied  controls,  in  order  to  determine  the  set  of  controls  feasible  at  each  de¬ 
cision  instant,  and  hence  the  set  of  feasible  control  vectors.  However,  since  no 
updates  on  the  attackers  states  will  be  provided,  the  target  must  predict  which 
controls  will  be  feasible  at  each  decision  instant.  This  is  done  by  predicting  the 
states  of  the  attackers  at  each  decision  instant.  A  set  of  feasible  control  vectors 
based  on  these  predictions  is  then  determined.  The  target  assumes  each  attacker 
maintains  a  radial  trajectory  toward  the  target  given  by 

ri{t)  =  -  VA{t  -  Ti)  ;  t,  -  /i£,  <  t  <  t,  -t-  /in 

i  r,  -  /lu  <  t  <  T,  -I-  /in 
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A(0  = 


T  Ti  ~  /<D  <  <  <  T,  +  /in 
T  otherwise. 


(2.1) 


for  the  attacker. 

These  states  are  used  to  predict  the  time  periods  diiring  which  each  control 
will  be  feasible.  Recall  that  a  decoy  deployed  at  time  i  cannot  affect  the  tracking 
state  of  any  attacker  whose  range  is  within  a  radius  td  of  the  target  at  time  t. 
The  i*'*  attacker  will  reach  the  range  tq  at  time  ,  assuming  it  maintains 

a  radial  trajectory  toward  the  target.  Either  decoy  is  therefore  a  feasible  control 
every  Ad  time  units  during  the  periods  [rj  —  /id,  for  t=l,...,n.  Recall 

also  that  an  attacker  must  be  within  a  range  tq  of  the  target  in  order  to  employ 
the  hardkill  system  against  that  attacker.  The  i‘*  attacker  will  reach  the  range 
tb  at  time  t,  +  assuming  it  maintains  a  radial  trajectory  toward  the 

target.  The  target  can  fire  on  the  t**  attacker  every  Ajs  time  units  until  time 
Tj  +  /in-  The  hardkill  system  is  therefore  feasible  control  against  the  ***  attacker 
during  the  time  period  (t,  +  If  a  decision  instant  occurs  at  a 

time  when  neither  a  decoy  nor  the  hardkill  system  is  feasible,  the  only  control 
available  to  the  target  is  the  Z  (do  nothing)  control. 

A  set  of  predicted  feasible  control  vectors  can  then  be  determined  combina- 
torially  from  knowledge  of  the  controls  predicted  to  be  feasible  at  each  decision 
instant.  The  set  Uk  contains  the  controls  predicted  to  be  feasible  at  time  t*. 
The  number  of  predicted  feasible  control  vectors  is  given  by: 

n 

k=\ 

where  [  ]  is  the  czu-dinality  of  the  set  Uk- 
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Consider  a  tree  with  K  levels,  where  each  level  corresponds  to  a  decision 
instant.  At  the  level  of  the  tree,  there  are  HfJi*  I  I  nodes  with  |  Uk  \ 
branches  emanating  from  each.  The  branches  represent  the  feasible  controls 
at  time  tk.  Every  complete  path  through  the  tree  represents  a  feasible  control 
vector. 

In  each  of  the  three  formulations,  the  same  set  of  predicted  feasible  control 
vectors  is  searched  to  find  the  respective  optimal  allocation  schemes,  that  is 
there  is  only  one  set  of  predicted  feasible  control  vectors. 

2.1.1  Deterministic  Formulation 

Suppose  the  tracking  methods  of  the  attackers  are  known  to  the  target  a 
priori.  The  arrival  state  of  the  attacker  is  given  by 

(r,(T,)  =  rA,6i{Ti),Pi{Ti)  =  r,a<,T<), 

where  0f(Ti),  t^,  and  q,-  are  given. 

Using  the  expression  for  the  cost  function  given  in  (1.7),  the  optimal  alloca¬ 
tion  scheme  is  the  control  vector  which  achieves  the  following: 

n  <(<‘>(1  -  /”„(<.))]}•  (2.2) 

The  solution  vector  is  denoted  by  Uopt- 

Computing  Uopt  requires  computing  (1.7)  for  every  path  in  the  tree,  using  the 
state  predicting  equations  in  (2.1),  and  then  comparing  the  resulting  n*Li  I  I 
quantities  to  find  the  maximum. 

Although  this  exhaustive  search  is  guaranteed  to  find  the  solution  to  (2.2), 
this  method  is  undesirable  if  K  is  large.  Instead  of  exhaustively  searching  the 
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set  of  predicted  feasible  control  vectors,  the  same  Uopt  can  be  obtained  by  ex¬ 
haustively  searching  only  the  set  of  controls  predicted  to  be  feasible  at  each 
decision  instant,  determining  Uopt  element  by  element. 

At  a  given  level  in  the  tree,  all  branches  leaving  a  specific  node  are  compared. 
One  branch  is  selected  which  leads  to  one  of  the  nodes  at  the  next  level.  The 
control  associated  with  the  surviving  branch  is  the  control  applied  at  the  decision 
instant  corresponding  to  that  level.  In  this  manner,  the  optimal  path  is  traced 
out  sequentially.  Consider  the  following  algorithm. 

Algorithm  1: 
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Example: 


Suppose  n=l  (one  missile),  K=2,  and  there  are  only  two  countermeasures:  0 
and  1.  Suppose  also  the  probability  of  success  of  the  countermeasures  are  time 
invariant.  Let  Po{t)  =  a  and  Piit)  =  6,  where  a  >  b. 

Exhaustive  Search: 

max{Putiti)  +  -  -P«,(<i))} 

=  max{a  +  a(l  —  a),a  +  b(l  —  a),b  +  b(l  —  b)} 

=  a  +  a(l  -  a)  =  (0, 0). 

Algorithm  1: 

Step  1: 

max{Pttj(ti)}  =  max{a,b}  =  a  =►  uj  =  0. 

»i€Wi 

Step  2: 

ni^{P«*(<i)  +  —  P 

€Wa  * 

=  max{a  +  a(l  —  a),  a  +  b(l  —  a)} 

=  a  +  a(l  —  a)  =»  uj  =  0. 

Therefore  u^\=(0,0)=Uop<- 

Proof: 

Induction  is  used  to  show  that  Algorithm  1  and  the  exhaustive  search  both 
arrive  at  the  same  Uopt-  1^  is  desired  to  show  that  J(uopi)  =  that  is  to 
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show  the  following: 

niax{nE  -  Pi^iti))]} 

“'f  1=1  fc=i  1=1 

(=1  k^l  1=1 

= "23jc{n{(^  n  -  Pu;M)i 

i=l  *=1  1=1 

+^uK(</^)nV -<•(</))]),  (2-4) 

l-t 

where  the  axe  the  K  controls  determined  by  Algorithm  1. 

Without  loss  of  generality,  assume  n=l.  For  notational  convenience  in  this 
proof,  the  quantity  P^^iik)  will  be  denoted  by  Recall  uk  =  («!, w/f)- 
For  A'=l,  the  vector  tii=ui,  and  the  following  is  true; 

max{Pvi }  =  max{/\„  )  =  Puj, 

Cl  *** 

so  the  equality  in  (2.4)  holds. 

Now  assume  (2.4)  is  true  for  K  =  m  so  that 

inax{Pu,  +  PutO-  ~  ~  P (1  ~  )} 

t*m 

=  P,;  +  ...+  -  P-\) 

=  max  {P.;  +  ...  +  P..(l  -  -  Pu-))-  (2-5) 

Urn€Um 

It  must  now  be  shown  that  (2.4)  is  true  for  I<  =  m  +  1,  that  is 
max{P„,  +  ...  +  •/^Um(l  ~  P Um-I  )”-(^  “  ^“1  ) 

Um-f  1 

+Pu„,Ai  -  P.J-M  -  P.J) 

=  Pul  +  •••  +  /’u;;(l  -  ■P’u;._,)  ”(l  -  Pul) 
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=  +  ...  +  Pu-Jl  -  /I;;.,  )...(1  -  P.-) 

+^u^+.(l  -  Pui,).M  -  Pul)}  (2.6) 

Using  (2.5)  and  (1.8),  the  right  hand  side  of  (2.6)  becomes 

=  m^{niax{P„,  +  ...  +  P„„(l  -  )...(!  -  p,, )} 

+/U4.II  -  {Pul  +  ...  +  Pu-Jl  -  /I;;.. )...(!  -  Pul))]}. 

Using  (2.5)  again  this  becomes 

=  max{inax{P,.,  +  ...  +  P^(l  -  P„„_, )...(!  -  P,.,)) 

+^«-.+i  [1  -  max{P«,  +  ...  +  P„„(l  -  P^^, )...(!  -  P„, )}]}. 

Grouping  terms  gives 

=  n\ax{max{P„,  +  ...  +  Pu„(l  -  Pv„., )...(!  -  P„,)} 

’**»»+»  Urn 

~  Pum-H  )  Pum-il  }• 

Since  u^+i  is  not  included  in  a  search  over  this  becomes 

=  max{max{(P„,  +  ...  +  P,^(l  -  Pu,„_, )...(!  -  P„J] 

«m+I  Um 

^  (1  ~  Pum-H  )  +  Pum-H  }  }  • 

Using  (1.8)  yields  the  left  hand  side  of  (2.6): 


=  max{P,.,  +  ...  +  P„„(l  -  P„„_, )...(!  -  P„,) 

+  ^m+l(l  -  •^Um)  — (1  -  Pui)}q.E.D. 


Algorithm  1  is  a  trimmed  search.  At  the  decision  instant,  it  selects  one 
of  the  I  Uk  I  feasible  controls,  which  means  it  compares  |  Uk  1  control  vectors 
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that  only  differ  in  the  last  element,  so  that  from  the  first  level  to  the  level, 
a  total  of  I  Uk  I  path  comparisons  were  made  to  obtain  Uopt,  as  opposed  to 
a  total  of  n^Li  I  I  path  comparisons  required  in  an  exhaustive  search. 

2.1.2  Minimax  Formulation 

Now  suppose  that  the  tracking  methods  of  the  attackers  will  never  be  known 
to  the  target,  and  that  no  a  priori  probability  distribution  describing  this  param¬ 
eter  is  available.  Recall  that  an  attacker  employs  one  of  two  possible  tracking 
methods  to  decide  in  which  direction  to  travel:  leading-edge  tracking  {LE)  or 
centroiding  tracking  (CEN).  The  tracking  method  is  one  of  the  parameters 
that  determines  the  probability  of  a  countermeasure  successfully  causing  the 
attacker  to  transition  from  the  tracking  state  into  the  not-tracking  state,  and  is 
therefore  one  of  the  parameters  that  determines  the  probabih'ty  of  target  sur¬ 
vival.  A  minimax  formulation  is  applied  to  find  the  best  allocation  scheme  in 
this  situation. 

Recall  from  the  introduction  that  q,  denotes  the  tracking  method  of  the 
attacker,  where  Oj  €  {LE,CEN}.  Let  Q=(ai,  ...,q„)  represent  the  tracking 
method  vector  for  n  attackers.  There  are  2"  possible  tracking  method  vectors. 

Define  the  conditioned  cost  to  be  the  probability  of  target  survival 

using  allocation  scheme  u^c^  assuming  the  tracking  method  vector  is  the  true 
tracking  method  vector.  The  target  seeks  a  control  vector  which  maximizes,  over 
all  feeisible  control  vectors  uk,  the  minimum  of  the  conditional  costs: 

min{Ri(uK ),  R2"(uk)}-  (2.7) 

The  control  vector  achieving  this  maximum  is  denoted  Uopt- 
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The  turivaJ  state  of  the  attacker  is  given  by 


(r,(T,)  =  r4,d.(T,),  A(n)  =  T,ai,Ti), 

where  and  r,  are  given,  and  this  time  a,  is  unknown. 

Using  the  expression  for  the  cost  function  given  in  (1.7),  the  cost  of  Uopt  is 
written  as 


=  maxminPr(Miss). 

Sk  s 

=  maxmin{n[53  H  KMil  ~  (</))]}•  (2.8) 

«  i=i  fc=i  /=i 

Determining  Uopt  by  exhaustive  search  requires  solving  (2.8),  which  involves 
calculating  the  minimum  of  the  conditional  costs  for  every  path  in  the  tree,  and 
then  comparing  the  resulting  nlLi  I  I  quantities  to  find  the  maximum. 

Instead  of  exhaustively  searching  the  set  of  feasible  control  vectors  to  find 
Uopt,  a  sequential  algorithm  can  be  applied  that  will  result  in  the  same  Uopf  This 
algorithm  is  similar  to  Algorithm  1,  and  differs  from  it  only  in  the  criterion  by 
which  it  selects  the  survivor  path. 

Algorithm  2: 

(1)  At  time  /j,  apply  the  control  that  achieves 

n 

maxnun{fl  /’^.(ti)}- 
“  .=1 

Denote  this  control  by  uj. 

(2)  At  time  <2»  apply  the  control  that  achieves 

maxm]n{Jl[F^(<i)  +  P,l,(t2)(l  -  •Pu;{<i))]}- 

1*2  O  -  *  * 
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Denote  this  control  by  u^. 

(3)  At  time  tm,  sipply  the  control  that  achieves 


n  m  — 1  k—1 


m  —  1 


max  min 

Um  a 


fiiiiE  n  -  <•('-))) + PLM  no- 

1=1  k^i  1=1  1=1 


Denote  this  control  by  u^. 

(4)  Continue  until  K  controls  have  been  determined.  The  optimal  control  vec¬ 
tor  is  given  by  =  (uj, 

The  cost  of  is  given  by: 

•'(“«)  =  nii:n/'-:(‘oo-^;;(i/))i.  (2.9) 

i=i  ib=i  1=1 


Example: 


Suppose  n=l  (one  missile),  if =2,  and  there  are  only  two  countermeasures:  0 
and  1.  Suppose  also  the  probability  of  success  of  the  countermeasures  are  time 
invariant  and  depend  only  on  the  tracking  method.  For  the  probability  of  success 
of  the  countermeasures  given  in  the  table  below,  assume  b<c<d<a: 

a  £  i 
LE  a  b 
CEN  c  d 

Exhaustive  Search: 

maxnun{Fu,(ti)  -f  Fuj(^2)(l  -  PuiiU))} 

U2  O 

=  max{min(a-f  a(l  —  a),c  -f  c(l  —  c)],min(a-f  b(l  —  a),c  -f  d(l  —  c)], 
minfb  -f  a(l  —  b),d  -1-  c(l  —  d)],min[b  -I-  b(l  —  b),d  -I-  d(l  —  d)]} 

=  c  -f  d(l  -  c)  =»  Uopt  =  (0,1). 
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Algorithm  2: 
Step  1: 


max  min{/\„(ti)}  =  max{min(a,c],min[b,  d]}  =  c  =>  uj  =  0. 

Step  2: 

max  nun{P«.(ti)  +  P«,(t2)(l  -  PuAh))} 

€^2  a  *  ^ 

=  max{min[a+ a(l  -a),c  +  c(l  —  c)],min[a+ b(l  -a),c  +  d(l  -c)]} 
=  c  +  d(l  —  c)  =»  Uj  =  1. 

Therefore  u^’^=(0,l)=trop,. 

Proof; 


Induction  is  again  used  to  show  that  Algorithm  2  and  the  exhaustive  search 
both  arrive  at  the  same  u^,.  It  is  desired  to  show  that  J{uopt)  =  that 

is  to  show  the  following: 


maxnnn{n(J3  fl  -  P«* (</))]} 

®  <=i  *=i  (=1 


1=1  ib=i  1=1 


=  n  -  H;M)] 


/=1 


(2.10) 


where  the  are  the  K  controls  determined  by  Algorithm  2. 

Without  loss  of  generality,  assume  n=l.  For  notational  convenience  in  this 
proof,  the  quantity  will  be  denoted  by  Recall  uk  =  (ui, u/,). 
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For  K—l,  the  vector  ui=ui,  and  the  following  is  true: 

maxmin{F„, }  =maxmin{P„  }  =  P^., 

uj  5  “1  o  * 

SO  the  equality  in  (2.10)  holds. 

Now  assume  (2.10)  is  true  for  K  =  m,  so  that 


maxrnin{P„,  +  P„,(l  -  P*.)  +  ...  +  Pu„(l  -  Pu„., )...(!  -  Pu,)} 

=  Pul  +  ...  +  P„;;.(l  -  P„;,_, )...(!  -  P„j) 

=  )...(!  -  Pul)}.  (2.11) 

It  must  now  be  shown  that  (2.10)  is  true  iot  K  =  m  +  1  that  is, 


maximn{P„,  +  ...  +  P,*„,(l  -  P„„_, )...(!  -  P„,) 

«*m+l  a 

=  Pul  +  ...  +  Pu;,(l  —  Pu;;_, )...(!  —  Puj) 
d-Pu;;^,  (1  —  Pu;; )...(!  —  Puj) 

+  P„„^.(l~P„;.)...(l-P„j)}.  (2.12) 

Using  (2.11)  and  (1.8),  the  right  hand  side  of  (2.12)  becomes 

=  max  min  {max  nun  {P„,  +  ...+  P,^(l  -  Pu„,_, )...(!  -  Pu,)} 

•‘m+l  a  Urn  O' 

+n„.,  |1  -  +  ...  +  -  fti., )...(!  -  />.;))!}. 

Using  (2.11)  again  this  becomes 

=  maxmin{maxmin{P„,  +  ...  +  Pum(l  ~  Pu™_, ).■.(!  -  Pu,)} 

tAm^l  Q  tTm  S 

+  ^«m4iU  -  maxmm{P,„  +  ...  +  P„„(l  -  Pu„_, )...(!  -  Pu,)}]}. 

t^m  O 
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Grouping  terms  gives 


=  maxmin{maxmin{P„,  +  ...  +  Pum(l  ~  ^um-i)  "(l  ~ 

«m+»  S  Um  S 

X(1  -■Pu„...)  +  ^U«4.}- 

Since  is  not  included  in  a  search  over  Um  this  becomes 

=  maxmin{maxmin{[P«.  +  ...  +  P«h»(l  —  —  ^m)] 

“m+l  S  Cm  S 

x(l  -Pu«^J  +  Pu«4l})- 

Using  (1.8)  yields  the  left  hand  side  of  (2.12): 

=  maxmin{Pui  +  —  +  Pt.„(l  ~  ■Pu„_i)-(1  “  P.,) 

«*m+l  O 

+  Pm+l(l  -  /’u* )..•(!  -  Pui)]Q.E.D. 

Algorithm  2  is  also  a  trimmed  search.  As  with  Algorithm  1,  a  total  of 
I  Wfc  1  path  comparisons  were  made  to  obtain  Ugpf,  as  opposed  to  a  total  of 
njbLi  I  1  path  comparisons  required  in  an  exhaustive  search. 

2.1.3  Bayesian  Formulation 

Suppose  again  that  the  tracking  methods  of  the  attackers  are  unknown  to  the 
target,  but  that  a  prior  probability  distribution  describing  the  tracking  method 
of  the  attackers  is  available.  A  Bayesian  formulation  is  applied  to  find  the  best 
allocation  scheme  in  this  situation. 

Let  a=(ai, ...,Q„)  represent  the  tracking  method  vector  for  n  attackers. 
There  are  2”  tracking  method  vectors.  Let  5j  denote  the  j"*  tracking  method 
vector,  and  let  irj  be  the  probability  that  Sj  is  the  true  tracking  method  vector. 
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The  target  seeks  a  control  vector  which  maximizes,  over  all  feasible  control 
vectors  the  Bayes  risk  given  by 

+  R2{^k)‘^2  +  —  +  (2.13) 

where  )  is  the  conditional  risk  defined  in  Section  2.1.2.  The  control  vector 

achieving  this  maximum  is  denoted  by  Uopt. 

The  arrival  state  of  the  attacker  is  given,  as  in  Section  2.1.2,  by 

(r,(T,)  =  r^,d.(T.),/3,(T,)  =  T,a„Ti), 

where  and  Ti  are  given,  and  Oi  is  unknown. 

The  cost  of  Uopt  is  given  by 

J{^opt)  =  maxf’r(Miss) 

2" 

=  nia::{]^Pr(Miss  I 

=  n  I  “i)(l  -  Pl,{U  I  5,))]]ir,} 

j=i  .=i  *=i  tel 
2" 

=  max  { 53  )7rj}.  (2.14) 

“*■  j=i 

Determining  Uopt  by  exhaustive  search  requires  solving  (2.14),  which  involves 
calculating  the  quantity  in  (2.13)  for  every  path  in  the  tree,  and  then  comparing 
the  resulting  Ot^si  I  |  quantities  to  find  the  maximum. 

Instead  of  exhaustively  searching  the  set  of  feasible  control  vectors  to  find 
Uopt,  a  sequential  algorithm  can  again  be  applied  that  will  result  in  the  same 
Uopt-  This  algorithm  is  similar  to  Algorithms  1  and  2,  and  differs  from  them 
only  in  the  criterion  by  which  it  selects  the  survivor  path, 
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Algorithm  3: 


(1)  At  time  ti,  apply  the  control  that  achieves 

2“  n 

Ein 

i=i  i=i 

Denote  this  control  by  uj. 

(2)  At  time  fj,  apply  the  control  that  achieves 

I  “i)  +  1  s,)(i  -  <•((,  1 5,))i)x^}. 

j=l  «=I 

Denote  this  control  by 

(3)  At  time  &pply  the  control  that  achieves 

■^ciniiE  n  <•('*  I  Si)(i  -  1 5y))i 

"  j=i  i=i  i=i  ' 


+n„('n.  1 5;)  li'd  -  />;•(<.  1 

<sl 


Denote  this  control  by  u^. 

(4)  Continue  until  K  controls  have  been  determined.  The  optimal  control  vec¬ 
tor  is  given  by  =  {u\, 

The  cost  of  u^t  is  given  by 

2**  ^  ib— 1 

=  EinEII^;:(‘‘|5,)(i-<.(<,|5i))lK.  (2.15) 

j=l  t=l  kszi  /=! 


Proof: 


As  in  Sections  2.1.1  and  2.1.2,  induction  is  used  to  show  that  Algorithm  3  and 
the  exhaustive  search  both  arrive  at  the  same  Uopt-  It  is  desired  to  show  that 
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J {^opt)=J{Uopt)'>  show  the  following: 

2^  n  K  k'^X 

ni“(E[nc  n  KAh  I  “.xi  -  1 5, ))!)»,} 

j=i  1=1  jfc=i  i=\ 

= EiniE  n  pt-A^i  I  “>)(>  -  ■f’irf''  I 

>=i  i=i  i=i  /=i 

A  JC*“l  /b*“l 

=  "““{ElIIIlE  n  I  -  <•«!  1 5.))1 

^  J=1  i=t  ib=l  1=1 

+PL(tK  I  “i)  n'(l  -  PlA^i  I  5i))ll»i}-  (2.16) 

1=1 

where  the  uj,  are  the  /f’  controls  determined  by  Algorithm  3. 

Without  loss  of  generality,  assume  n=l.  For  notational  convenience  in  this 
proof,  the  quantity  1  oj)  will  be  denoted  by  .  Recall  u/^'=(uiy u/c). 

For  K=l,  the  vector  ui=iii,  and  the  following  is  true: 

2  2 
‘  i=i  i=i 

so  the  equality  in  (2.16)  holds. 

Now  assume  (2.16)  is  true  for  K  =  m,  so  that 

•••■I'  ~  )-"(^  ~ 

>=1 


=  +  ...  +  Pu„i,(l  -  Pu-„_^^):. 


(2.17) 


It  must  now  be  shown  that  (2.16)  is  true  for  /f  =  m  +  1,  that  is 


rpax{  +  ...  +  Pu„^,  (1  -  Pu„.,^,  )-(l  -  Pu,^, ) 


Um+l 
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+p. 


“m+lb  ' 


••'  ■*■  -^“-b ~  -^"-.b ^  “  -^-.*0  ^ 

m^{i:(p«jb  +  -  +  ^-«b  "  ^“^-.b  -  ^-rb ) 


j=» 


+  -P«^+lb(^  -^“mb^'''^^  )]’'■>}• 

Using  (2.17)  and  (1.8),  the  right  hand  side  of  (2.18)  becomes 


~~  •••  -^“mb^^  -^“m-lb  )'"(^  •^“lb)l*^i) 

**•••▼*  WfH 


(2.18) 


+ E  P.-...  II  -  (P.:„  +  - + P.;,(i  -  P-i.,,  )-(i  -  p.:,  ))l-r,}. 

j=» 


Using  (2.17)  again  this  becomes 


+  iz  ^»m+ibK  “  +  - 


i=i 


Urn  ■ 


3-i 


...+  .Pu„j,(l  ■^U,»_Jb  )*”(^ 


Grouping  terms  gives 


=  ra^{nia}c{  +  ...  +  P„„J1  -  )...(!  -  P-.Jljr,) 


«m41  Sm 


X(1  -  E  ^’‘«4lb  )  +  E  ■P«m4.b’^i}- 

j=i  ;=i 

Since  u^+i  is  not  included  in  a  search  over  u„,  this  becomes 
=  max{inax{El^’»,b  +  -  +  ^«n.b(l  ~  -^-m-ib) 


^^+1  lAm 


X(1  -  E^«m4.b)  +  E^“m4.b’^j])}- 

J=l  J=1 
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Using  (1.8)  yields  the  left  hand  side  of  (2.18): 

2 

~  •"  )•••(* 

“m+l  j-i 

Algorithm  3  is  again  a  trimmed  search.  As  with  Algorithms  1  and  2,  a 
total  of  TliLi  1  I  comparisons  are  made  to  obtain  Ugpt,  as  opposed  to 
n^Li  I  I  path  comparisons  required  in  an  exhaustive  search. 

Note  that  since  the  set  of  predicted  feasible  control  vectors  is  defined  a  priori, 
the  optimal  allocation  scheme  in  each  formulation  can  be  determined  a  priori. 

Algorithms  1,  2,  and  3,  were  applied  to  several  attack  scenarios,  and  the  re¬ 
sulting  optimal  control  vectors  and  corresponding  probabilities  of  target  survival 
are  given  in  Chapter  5. 


2.2  States  Updates  Available 

Now  suppose  updates  of  the  attackers  states  will  be  provided  to  the  target 
every  A  time  units.  When  a  decision  instant  occurs,  the  target  uses  the  update, 
and  the  knowledge  of  the  previously  applied  controls,  to  determine  the  set  of 
controls  currently  feasible. 

Obtaining  the  control  vector  which  maximizes  the  quantities  in  (2.2),  (2.8), 
and  (2.14)  involves  exhaustively  searching  over  a  set  of  feasible  control  vectors  of 
dimension  K.  However,  because  the  controls  feasible  at  a  given  decision  instant 
will  not  be  known  until  that  decision  instant  actually  occurs,  this  set  cannot  be 
completely  determined  until  time  Therefore  Uopt  cannot  be  determined  prior 
to  the  first  arrival,  and  the  optimal  control  to  apply  at  each  decision  instant 
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must  be  determined  at  the  time  the  decision  instant  occurs. 

However,  if  a  set  of  feasible  control  vectors  is  defined  at  every  decision  instant, 
it  is  possible  to  use  exhaustive  search  to  determine  the  optimal  allocation  scheme 
in  each  formulation  element  by  element.  This  requires  defining  a  total  of  K  sets 
of  feasible  control  vectors.  The  members  of  each  set  depend  on  the  previously 
applied  controls,  the  currently  feasible  controls,  and  the  controls  predicted  to 
be  feasible  at  the  remaining  future  decision  instants.  The  predicted  controls  are 
determined  as  in  Section  2.1,  by  predicting  the  future  states  of  the  attackers. 
The  set  of  predicting  equations  for  this  case  takes  advantage  of  the  updates,  and 
is  slightly  different  from  the  set  of  predicting  equations  given  in  (2.1).  At  the 

decision  instant,  if  the  attacker  is  in  the  tracking  state,  its  future  states 
are  predicted  according  to  the  following  equations: 

ri(i)  =  -  VA(t  -Ti)  ;  tk  <  t  <  tx 

Oi{i)  =  ;  ik<t  <tK 

=  T;tk<i<tK-  (2.19) 

If  the  t**  attacker  is  in  the  not-tracking  state  at  time  f*,  it  is  no  longer  a  threat 
to  the  target  as  it  cannot  transition  back  into  the  T  state,  and  it  is  not  necessary 
to  predict  its  future  states. 

The  set  of  feasible  control  vectors  defined  for  the  decision  instant  contains 
a  total  of  I  I  members.  The  first  k  -  I  controls  are  fixed.  Denote  these 
controls  by  uj,  The  set  Uk  contains  the  controls  currently  feasible.  The 

sets  i/,  for  i  =  it  +  1,  ...,K  contain  the  controls  predicted  to  be  feasible  at  times 

^fc+l  1  ...I 

In  the  deterministic  formulation,  where  the  tracking  methods  of  the  attackers 
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are  known  a  priori,  at  time  tk  this  set  of  vectors  is  searched  to  find  the  vector 
which  achieves 


.5”“  {ftiE  n  -  /’i(i,)))}. 


•=1  ksl  /=1 


(2.20) 


where  Uj  =  u*  for  i  =  1, k—1.  The  element  in  the  ib**  position  of  the  resulting 
vector  is  the  control  applied  at  time  f*.  This  control  is  denoted  by  uj  and  is  the 
element  in  the  position  of  Uopt-  The  tlopi  determined  by  this  method  is  given 
by  Uopt  = 

In  the  minimax  formulation,  where  the  tracking  methods  of  the  attackers 
are  totally  unknown,  and  there  is  no  prior  probability  distribution  available 
describing  this  parameter,  at  time  t*  the  set  of  vectors  is  searched  to  find  the 


vector  which  achieves 


n  K  k-l 


max  imn{[nC  11  -  KMi))]]), 


“* . “If  s 


(2.21) 


•=i  fc=i  1=1 


where  u,=u*  for  t=l,...,fc  -  1.  The  element  in  the  lb*'*  position  of  the  resulting 
vector  is  the  control  applied  at  time  tk-  This  control  is  denoted  by  ul  and  is  the 
element  in  the  position  of  Uopt-  The  determined  by  this  method  is  given 
by  Hop'  =  (ul,...,uj^). 

In  the  Bayesian  formulation,  W'here  the  tracking  methods  of  the  attackers 


are  again  totally  unknown,  but  there  is  a  prior  probability  distribution  available 
describing  this  parameter,  at  time  ik  the  set  of  vectors  is  searched  to  find  the 
vector  which  achieves 


2"  n  K  k- 


%  V  4  1 


element  in  the  position  of  Uopt-  The  Uopt  determined  by  this  method  is  given 

by  Uopt  = 

In  all  three  formulations,  after  the  last  control  is  determined,  each  ex¬ 
haustive  search  approach  will  have  made  a  total  of  n*Lm  I  1  P^'-b 
comparisons  to  obtain  Uopt- 

Applying  Algorithms  1,  2,  and  3  will  yield  the  same  u^t  as  their  respective 
exhaustive  search  approaches.  It  was  shown  in  Section  2.1.1.,  that  for  the  same 
set  of  feasible  control  vectors,  the  optimal  control  vector  determined  by  Algo¬ 
rithm  1  was  equal  to  the  optimal  control  vector  determined  by  solving  (2.2). 
Therefore  the  K  control  vectors  that  w'ould  result  from  solving  (2.20)  at  each 
decision  instant,  will  equal  the  K  control  vectors  that  would  be  determined  by 
applying  Algorithm  1  at  each  decision  instant.  Similarly,  it  was  shown  in  Sec¬ 
tions  2.1.2  and  2.1.3,  that  Algorithm  2  and  Algorithm  3  yield  the  same  optimal 
allocation  scheme  as  their  respective  exhaustive  searches.  Therefore  the  K  con¬ 
trol  vectors  that  would  result  from  solving  (2.21)  and  (2.22)  at  each  decision 
instant,  will  equal  the  K  control  vectors  that  would  be  determined  by  applying 
Algorithm  2  and  Algorithm  3  at  each  decision  instant. 

However,  it  is  not  necessary  to  define  a  set  of  feasible  control  vectors  at  each 
decision  instant  for  Algorithms  1,  2,  and  3  to  find  the  optimal  controls.  At 
time  tfc,  each  algorithm  selects  uj  from  the  set  of  controls  currently  feasible, 
using  only  the  knowledge  of  the  states  of  the  attackers  at  times  and 

knowledge  of  the  controls  applied  at  times 

In  the  deterministic  formulation,  at  time  it  Algorithm  1  applies  the  control 
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that  achieves  the  following 


max 

Uk€i<» 


n  fc— 1  m— 1 


k-1 


(IIIE  n  -  P:r(‘.))l  +  <«»)  11(1  -  P‘.(1,))}, 

J _ t  — _ _ «  f _ «  •  -  • 


(2.23) 


where  the  u-,  are  the  controls  that  were  applied  at  the  first  A:  -  1 

decision  instants. 


In  the  minimax  formulation,  at  time  tfc  Algorithm  2  applies  the  control  that 


achieves  the  following 


n  k—i  m—1 


n  K-Jtrn){l  -  Pi.{il))]  +  Pi,{tk)U(^  -  Pt.{t,))},{2.2i) 

where  the  u",  i=l,...,A:-l  are  the  controls  that  were  applied  at  the  first  it  —  1 
decision  instants. 

In  the  Bayesian  formulation,  at  time  Algorithm  3  applies  the  control  that 
achieves  the  following 

j"«<5niiS  I  “i)(i  -  1 5,))j 

jsl  i=l  msl  l=l 

I  nV  -  I  5i))lK),  (2.25) 


where  the  u*,  i  =  1, k—l  are  the  controls  that  were  applied  at  the  first  it  —  1 
decision  instants. 


Algorithms  1,  2,  and  3,  have  two  advantages  over  their  respective  exhaustive 
search  approaches.  The  first  is  that  they  do  not  require  determining  K  sets 
of  feasible  control  vectors  at  each  decision  instant,  which  involves  predicting 
future  attacker  states,  in  order  to  determine  the  The  second  advantage  is  a 
consequence  of  the  first.  After  the  last  control  uj-  is  determined,  the  exhaustive 
search  approaches  will  have  made  a  total  of  I  I  path  comparisons. 


In  contrast,  Algorithms  1,  2,  and  3  will  have  made  only  'Zk=i  1  W*  1  path 
comparisons. 
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Chapter  3 


Unknown  Arrival  Times 


Now  suppose  neither  the  arrivd  times  nor  the  arrival  angles  of  the  attackers 
are  known  to  the  target  a  priori.  As  a  result,  the  number  of  attackers  arriving 
in  the  interval  [0,0]  is  not  known. 

In  the  case  of  unavailable  updates,  finding  the  Uopt  in  each  of  the  three 
formulations  by  exhaustive  search  requires  knowledge  of  some  set  of  feasible 
control  vectors.  If  the  arrival  schedule  is  not  known  a  priori,  the  target  will 
never  know  if  any  attackers  have  2u-rived.  This  results  in  ein  infinite  number 
of  feasible  control  vectors,  and  it  makes  finding  the  optimal  control  vectors  by 
exhaustive  search  impossible. 
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If  at  each  decision  instant,  the  target  is  provided  with  an  update  of  the  states 
of  all  the  attackers  present,  it  can  use  this  information  and  knowledge  of  the 
previously  applied  controls  to  determine  the  set  of  controls  currently  feasible. 
However,  if  the  arrival  times  are  not  known  a  priori,  it  is  not  possible  to  predict 
the  controls  that  will  be  feasible  at  future  decision  instants  by  the  method  in 
Section  2.2,  and  using  exhaustive  search  to  determine  Hapt  in  each  of  the  three 
formulations  element  by  element,  as  in  Section  2.2,  is  not  possible. 

Hence  the  exhaustive  search  approach  cannot  be  used  to  determine  the  op¬ 
timal  control  vector  in  any  of  the  formulations  when  the  arrival  schedule  is  not 
known  prior  to  the  first  attacker’s  arrival.  However,  using  the  probability  of 
target  survival  in  (1.11),  Algorithm  2  can  be  applied  to  determine  Uop<  in  the 
minimax  formulation,  as  long  as  updates  of  the  attackers  states  are  provided  at 
each  decision  instant. 

Recall  a  decoy  deployed  at  the  decision  instant  can  affect  the  tracking 
state  of  any  attacker  that  arrives  in  the  time  interval  [tr^tr  +  If  the  target 
is  considering  deploying  a  decoy  at  time  U,  it  is  not  necessary  to  know  the 
exact  arrival  times  of  each  attacker  that  will  arrive  in  [tr>tr  +  hut  only 
the  number  of  attackers  that  will  arrive  in  [tritr  +  and  their  airrivaJ  angles, 
in  order  to  determine  the  best  control  to  apply  at  U.  Since  the  arrival  times 
are  unknown,  the  number  of  attackers  that  will  arrive  in  any  time  interval  is 
unknown.  Redefine  n  to  be  a  Poisson  random  variable  describing  the  number 
of  attackers  arriving  in  an  interval  of  length  fip.  Let  rij  denote  the  number  of 
attackers  present  at  time  U- 

As  described  in  the  introduction,  the  arrival  angle  of  an  attacker  can  be  in 
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any  one  of  M  sectors  with  equal  probability.  Let  ..M^nr+m)  repre¬ 

sent  the  arrival  angle  vector  for  m  attackers  arriving  in  tr  +  where  0,  € 
{5i,...,Sm}-  There  are  M"*  possible  arrival  angle  vectors.  Let  6m,y  denote  the 

arrival  angle  vector  of  dimension  m.  Let  Q„,+„=(ai, ...,  a„„  . Qn,+m), 

where  a,-  6  {LE,CEN}.  There  are  possible  tracking  method  vectors. 

The  probability  of  target  survival  is  written  as 


Pr(Miss) 

OO 

=  -P^CMiss  1  m  attackers  arrive  in  an  inter\'al  of  length  /ip) 

m=l 

y.Pr{m  attackers  arrive  in  an  inter\’al  of  length  no) 

OO 

=  ^  /’r(Miss  I  n  =  m)Pr(n  =  m) 

m=l 
OO  A/" 

=  E  5^  Pr(Miss  1  n  =  m,^^.y)Pr(0„.„)Pr(n  =  m).  (3.1) 

m=l  v=l 

Since  the  attacker  arrivals  are  independent,  and  the  arrival  rate  is  stationary, 
(3.1)  becomes 


OO  M" 

EE 


fn=l  v=l 


Pr(Miss  I  n  =  m. 


r  ,  1  (Apo)">e-^*^p 
ml 


(3.2) 


At  time  U,  the  target  first  determines  the  set  of  controls  currently  feasible 
Ur,  and  then  must  evaluate  the  following  expression  in  order  to  determine  u‘: 


«  ^  1  (Apo)’"c-^'*^ 

maxmm{>  >  -77—^ - - 

o  A/"*  ml 


Ti,+m  r  fc— 1 

x!  n  IE  n  1  »-..)(>  -  \  (3-3) 

•=I  *=1  /=! 

where  u,  =  u’  for  i  =  1,  ...,r-  1.  There  is  not  a  closed  form  expression  for  (3.3), 
and  there  are  an  infinite  number  of  terms.  This  expression  will  be  approximated 
by  truncating  the  sum  at  the  term  for  which  the  value  of  m  is  such  that  Pr(n  = 
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m)  <  e.  Denote  this  value  of  m  by  m.  The  quantity  evaluated  by  Algorithm  2 
at  tr  is  then  given  by 


maxnunt  >  >  — - ; - 


nr-fm  fc~l 

xi  n  IE  n  <('•  I  i  (3-4) 

ial  ib=l  Isl 

where  Ui=ii*  for  t=l,...,r  —  1.  The  control  that  achieves  the  maximum  is  denoted 
by  u*  and  is  applied  at  time  tr. 

It  must  be  shown  that  the  solution  u*  to  (3.4)  is  the  same  control  as  would  be 
determined  if  the  target  knew  that  exactly  n  attackers  would  arrive  in  [tr,  tr+Po], 
for  1  <  n  <  rh.  This  can  be  shown  by  induction. 

The  idea  behind  the  proof  is  to  show  that  if  the  maximum  of  a  sum  of 
functions  is  equal  to  the  sum  of  the  maxima,  then  each  function  is  maximized 
at  the  same  point. 


Proof; 


For  notational  convenience  in  this  proof,  the  following  quantities  are  defined: 


r  /c— 1 


k=l  <=1 

Af”*  ml 


The  expression  in  (3.4)  then  becomes: 

m  M’”  Tir+m 

max  rain  11  ^L7m]}. 

'  “th+nr 

Without  loss  of  generality,  assume  A/=l  and  nr=l.  It  is  desired  to  show  the 


following: 


m  l+»n  *n  1-fm 

max  min{  51  n  ^'7m}  =  51  7m  max  min  {  (?' } . 

"•**+'  m=l  i=l  m=l  •=! 
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For  rh=l,  there  is  only  one  term  in  the  sum, 

mjucmin{(5*(?*7i}  =  71  maxmin{Q‘0^), 

aij  Ur  aj 

SO  the  equality  in  (3.5)  holds. 

Now  assume  (3.5)  holds  for  m=p,  so  that 


maxmin{(3*QSi  +  —  +  0^— 

Sp+l 

=  7i  maxinin{(5^C?^}  +  ...  +  7pmaxmin{(^^..Q'’'*’’}.  (3.6) 

“r  5^,  Ur  5^, 

It  must  now  be  shown  that  (3.5)  is  true  for  m=p  +  1,  that  is 


maxmin{<3^(5Si  +  -  + 

“r  0^3 

=  7i  max  min {Q^ (5^ }  +  ...  +  7p  maxmin{(5\..Q'’} 

5p+J  Ur 

+7p+i  m^min{g*...g''+^}. 

“r  5p42 

The  left  hand  side  of  (3.7)  can  be  written  as 


(3.7) 


=  maxmin{maxmin{(5^(?^7i  +  ...  +  Q^-Q’^Sp  +  Q^‘--Q’^^7p+i}} 

Ur  Op+a  Ur  Op+I 

=  maxmin{maxmin{Q‘Q^7i  +  ...  +  Q^—Q'’'^^(7p  +  Q’’'‘’^7p+i)}}- 

Ur  Op+a  «r  Op+i 

Since  0^+2,  and  thus  is  not  included  in  a  search  over  Op+i,  using  (3.6) 


yields  the  right  hand  side  of  (3.7): 

=  maxmin{7i  maxmin{(5*Q^}  +  ... 

Ur  Op+a  Ur  a^, 

-  +  (7p  +  Q'’'^’7p+i)m^mjn{Q\..Q'^’}} 

Ur  Op+i 

=  maixniin{7i  maxmin{(5*Q^}  +  ... 

Ur  Otp+a  Ur  Op+I 

...  +  7pmaxinin{4>*...Q'^*}  +  7p+i  maxniin{(?‘...Q’’+^}} 

Ur  5p+,  Ur  Sp+, 

=  7i  maxmin{Q'(5^}  +  ...  +  7p  max  min{Q\..Q'’} 

Ur  -?p+j  Ur  Op^j 

+7p+i  maxmin{Q*...Q'’''‘^}Q.E.D. 

Ur  5p+j 
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The  length  of  the  interval  [0,0]  must  be  defined.  Time  zero  is  considered  to 
be  the  time  at  which  the  target  is  first  alerted  to  the  presence  of  an  attacker. 
The  time  0  can  be  defined  in  two  ways.  The  first  way  is  to  set  0  to  some 
predefined  value.  The  second  way  is  to  consider  0  the  moment  at  which  some 
predefined  amount  of  time  has  elapsed  since  the  last  arrival. 
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Chapter  4 

Neural  Network 


Hopfield  and  Tank  [1]  have  developed  a  neural  network  that  has  been  shown 
to  be  effective  in  solving  optimization  problems  by  mapping  them  to  analog 
computation. 

A  biological  nervous  system  makes  decisions  rapidly  by  operating  collec¬ 
tively  in  a  parallel  analog  mode.  Hopheld  and  Tank  designed  a  simple  analog 
electronic  nervous  system,  comprised  of  a  matrix  of  nonlinear  analog  elements, 
which  exhibits  the  essential  features  of  a  biological  nervous  system:  parallel  in¬ 
puts,  parallel  outputs,  and  extensive  interconnectivity  between  the  electronic 
neurons. 
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A  circuit  schematic  of  the  network  is  given  in  Figure  4.1.  Each  neuron  is 
represented  by  a  pair  of  amplifiers  with  a  parallel  RC  circuit  at  a  common  input. 
The  output  of  a  neuron  is  fed  back  to  its  input  and  can  also  be  connected  to 
the  input  of  any  other  neuron.  There  is  an  externally  supplied  current  into  each 


neuron. 


The  RC  circuit  helps  define  the  time  constant  of  a  neuron,  and  allows  for 
integration  of  all  the  input  currents  entering  the  neuron  from  other  neurons  in 
the  network.  The  synapse  between  two  neurons  is  represented  by  the  connection 
of  the  output  of  one  of  the  two  amplifiers  of  a  neuron  to  the  input  of  another 
amplifier  pair  through  a  resistor.  The  resistor  connecting  the  and  neuron 
is  denoted  by  Tij.  If  the  synapse  is  inhibitory,  the  output  of  the  inverting 
amplifier  is  connected  to  the  resistor.  If  the  synapse  is  excitatory,  the  output  of 
the  non-inverting  amplifier  is  connected  to  the  resistor.  The  magnitude  of  the 
synapse  is  determined  by  the  value  of  the  resistor.  The  external  input  current 
into  each  neuron  adjusts  the  general  excitability  of  the  neuron. 

The  voltage  into  the  amplifier  pair  is  denoted  by  Xj,  and  the  output  of 
the  j*'*  non-inverting  amplifier  is  denoted  by  Vj.  The  input /out put  relationship 
is  given  by  Vj=  i(l  -I-  tanh(^))=p(xj),  and  is  plotted  in  Figure  4.2. 

Suppose  there  is  a  total  of  N  neurons  in  the  network.  The  equations  describ¬ 


ing  the  dynamics  of  the  i*'*  neuron  are  given  by 


dxi 

It 

V: 


(4.1) 


where  RC  is  the  time  constant  of  the  RC  circuit  at  the  input  of  each  neuron. 

In  an  earlier  paper  by  Hopfield  (2),  it  was  shown  that  under  a  symmetric 


^  ampt^  o  in^^rtiriQ  on^tifcr 

•  ressor  in  Ty  nehicrk 

Figure  4.1:  Layout  of  neural  circuit. 


Figure  4.2:  Gain  curve. 


connection  matrix  {Tij  =  T:ih  the  outputs  of  the  neurons  converge  to  a  constant 
and  stable  state.  He  also  showed  that  if  the  rise  times  of  the  amplifiers  are  very 
short,  so  that  the  width  of  the  gain  curve  in  Figure  4.2  is  narrow,  the  stable 
states  of  the  network  locally  minimize  the  following  quantity: 

(4,2) 

^  i=l  >=1  i=l 

The  state  space  is  the  interior  and  border  of  an  N  dimensional  hypercube.  Since 
the  width  of  the  gain  curve  is  narrow,  Vj  is  ultimately  either  0  or  1,  amd  the 
minimum  of  (4.2)  occurs  at  one  of  the  2^  corners  of  the  hypercube. 

The  allocation  problem  must  be  mapped  onto  this  network.  The  first  step 
is  to  choose  a  representation  for  the  output.  Let  N  =  \^k\i  where  K 

is  the  number  of  decision  instants.  Arrange  the  neurons  in  a  I  I 
matrix.  Each  row  represents  a  control  and  each  column  represents  a  decision 
instant.  The  output  of  the  neuron  in  the  row  and  column  of  the  matrix 
is  given  by  Vxy  The  dynamics  of  the  (A,y)‘*  neuron  are  then  written  as: 

^  +  (4-3) 

and  (4.2)  is  written  as: 

El  =  -\'LT,'E,'LExi.yiV;,,Vyi-'£'£V;,Jxi.  (4.4) 

^  X  Y  t  ]  X  i 

When  the  network  stabilizes,  the  optimal  control  to  apply  at  time  tk  will  be 
determined  by  the  values  of  the  neurons  in  the  column  of  the  matrix.  For 
example,  suppose  A’=3  and  l/i={L,R,Z},  Wj  =  {L,i2,  Z},  and  Uz  =  {Gi,Z}. 
The  output  matrix  shown  below  gives  L,Gi). 
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ill 

L  1  0  0 

ROOD 
Z  0  0  0 

L  0  1  0 

ROOD 
Z  0  0  0 

G,  0  0  1 

Z  0  0  0 

Note  there  is  onJy  one  1  in  each  column  and  no  more  than  one  1  in  each  row 
for  a  total  of  K  I’s  in  the  matrix,  so  that  at  every  decision  instant  one  and  only 
one  of  the  controls  feasible  at  that  decision  instant  is  selected. 

The  next  step  is  to  determine  a  function  describing  the  network  that  when 
minimized  results  in  exactly  one  control  being  selected  for  every  decision  instant, 
and  also  yields  the  optimal  allocation  scheme.  A  function  meeting  the  first 
requirement  is  given  by  Hopfield  and  Tank  (1]: 

^  X  i  i^i  ^  i  X  X4Y 

(4.5) 

^  X  1 

where  A,  By  and  C  are  large  positive  constants.  The  first  term  is  minimized 
when  there  is  no  more  than  one  1  in  each  row.  The  second  term  is  minimized 
when  there  is  only  one  1  in  each  column.  The  third  term  is  minimized  when  a 
total  of  K  I’s  appear  in  the  matrix. 


The  second  requirement  is  met  by  appending  a  term  to  (4.5)  that  represents 
the  probability  that  the  target  does  not  survive  the  attacks.  From  (1.2),  (1.3), 
aind  (1.5),  the  probability  the  target  does  not  survive  is  given  by: 

Pr (Target  does  not  survive) 

=  1  —  Pr(Target  survives) 

=  1  -  nil  -  Pr(H|  1 

isl 

=  (4.6) 

<=1  k=l 

In  order  to  discourage  the  network  from  the  selection  of  some  controls,  and 
encourage  the  selection  of  others,  the  notion  of  a  “distance”  between  the  con¬ 
trols  must  be  defined,  and  these  distances  reflecu  J  in  the  connections  (Txi.yj's) 
between  the  neurons.  This  can  be  accomplished  by  isolating  the  probability 
of  failure  of  each  control  against  all  the  attackers,  so  that  the  “distance”  from 
one  control  to  another  is  the  probability  of  failure  against  all  the  attackers  of 
applying  that  control.  This  is  done  by  upper  bounding  the  the  expression  for 
the  probability  that  the  target  does  not  survive  in  (4.6). 

Define  a  set  S={bi,b^, 1)3,64  :  0  <  <  1,  *  =  1,2, 3,4}.  The  following 

relations  hold; 

(*)  6163  +  6364  <61-1-62  +  63-1-64 

(ii)  6162  <  1. 

Using  these  relations,  (4.6)  can  be  upperbounded  as 
Pr(Target  does  not  survive) 
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/si  k=l 

=  1  -  n  +  n/C  -  5;  Pt^itk) 

/si  k=l 

=  >-"  +  EE(i -/’«(<*)) 

/si  fcsl 

1=1  k=l 

=  i;di-/^.(<‘))-  (4-7) 

/fcsl  /si 

Define  the  quantity  dxY  ^  sum  of  the  probabilities  of  failure  against 
each  attacker  of  the  control  in  the  y‘*  row  applied  at  time  iy,  given  the  control 
in  the  row  was  the  last  control  applied.  That  is, 


dxY 


E(>  -  PyvcM). 


/si 


(4.8) 


where  ty  =  ik  i(  Y  €  Uk-  This  quantity  represents  the  “distance"  between  the 
controls  in  rows  X  and  Y.  A  control  must  be  applied  at  each  decision  instant, 
even  if  it  is  the  “do  nothing"  control.  In  other  words,  no  decision  instants  can 
be  skipped.  Therefore  it  is  required  that  /yi;f(tv')=0  for  1=1,. ..,n  \i  X  ^Uk,  but 
Y  ^  Hk+i  ■  Also  since  no  more  than  one  control  can  be  applied  at  each  decision 
instant,  it  is  required  that  for  1  =  l,...,n  if  X^Y  €  Uk-  This  is 

summarized  below: 


Er=.(l  -  7’n;r(<i')) 


if  A  6  IV*  and  Y  €  I4k+i 
otherwise. 


(4.9) 


From  these  quantities,  a  symmetric  distance  matrix  {dxY  =  dyx )  is  constructed. 
This  matrix  is  denoted  by  d. 
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The  following  term,  given  by  Hopfield  and  Tank  [1],  appended  to  (4.5)  as¬ 
sures  network  converges  to  the  scheme  with  the  minimum  cost,  (or  minimum 
“length”); 

+  VV,,-i).  (4.10) 

^  X  y^x  i 

It  yields  the  numeric  value  of  (4.7)  for  the  allocation  scheme  represented  by  the 
states  of  the  neurons  in  the  stabilized  network. 

The  function  descrbing  the  allocation  network  is  the  sum  of  (4.5)  and  (4.10): 

El  =  ^ S ^xiVxj  +  x 51 51  ^XiVyi 

^  X  i  ^  •  X  X^Y 

^  X  i 

+?5I  H  +  (4.11) 

^  X  Y^X  i 

When  this  function  is  minimized,  the  states  of  the  neurons  in  the  network  will 
represent  the  optimal  allocation  scheme. 

It  is  known  that  the  network  minimizes 

El  =  -\'^'^^'^Txi,Y}VxiVYj -J2J2^XiIxi-  (4.12) 

^  X  Y  i  j  X  i 

The  function  Ei,  and  the  function  that  is  desired  to  be  minimized  can  be 
made  equivalent  by  choosing  the  appropriate  set  of  Txi.y>’s  and  /jf.’s.  Hopfield 
and  Tank  [1]  have  determined  that  the  following  connection  matrix  and  external 
input  currents  make  (4.11)  equivalent  to  (4.12): 

lx,  =  CK  (4.13) 

Txi.Yj  =  ~  ^i>)  ~  E6ij{\  -  6xy)  -  C 

-DdxY{^},i+i  +  (4.14) 
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1  if  *  =  j 

= 

0  otherwise. 

Substituting  these  into  (4.3),  the  equations  describing  the  dynamics  of  the 
neuron  in  the  row  and  j**  column  are  given  by 

at  rto  Yjtx  X  3 

—D  52  rfjfv (VV.i+1  +  H’.i-i )  (4-15) 

Y 

Vxi  =  gi^xi)-  (4-16) 

The  derivations  of  (4.11)  from  (4.12)  and  (4.15)  from  (4.3),  using  the  quauitities 
in  (4.13)  and  (4.14),  are  given  in  Appendix  A. 

4.1  Deterministic  Formulation 

This  network  can  be  used  to  obtain  the  optimal  allocation  scheme  when  the 
arrival  times,  arrival  angles,  and  tracking  methods  of  the  attackers  are  known 
to  the  target  a  priori. 

4.1.1  State  Updates  Unavailable 

Suppose  no  updates  of  the  attackers’  states  will  be  provided.  The  only 
attacker  knowledge  provided  to  the  target  is  the  a  priori  knowledge  of  the  arrival 
states.  The  arrival  states  are  given  as  in  Section  2.1.1,  by 

(r.(r,)  =  r>,,^i(T.),^i(Ti)  =  r,Q„T.), 

where  6i{Ti),  t^,  and  Oi  are  given. 
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Using  the  expression  for  the  cost  function  given  in  (1.5),  it  is  desired  to 
determine  the  control  vector  which  achieves 

max{f[(l  -  nU (4.17) 

The  set  of  feasible  control  vectors  necessary  to  solve  (4.17)  is  determined  as  in 
Section  2.1. 

Since  the  control  applied  at  time  ik  must  be  a  member  of  the  set  of  controls 
feasible  at  tk,  the  network  is  not  allowed  to  consider  states  in  which  this  require¬ 
ment  is  not  met.  In  other  words,  the  network  is  only  allowed  to  consider  the 
feasible  control  vectors.  To  guarantee  this,  any  neuron  whose  position  in  the 
matrix  is  such  that  an  output  of  1  would  violate  the  above  requirement,  is  fixed 
at  0.  Therefore  Vxi(0=0  for  sJl  t,  if  X  6  Hk  aod  * 

When  the  network  stabilizes,  the  control  to  apply  at  the  decision  instant  is 
determined  by  the  value  of  the  neurons  in  the  the  column.  This  network  was 
used  to  determine  the  optimal  allocation  schemes  for  the  same  attack  scenarios 
as  considered  in  Section  2.1.  The  results  are  presented  in  Chapter  5. 

4.2  Choosing  Values  for  A,  B,  C,  and  D 

Hopfield  and  Tank  do  not  provide  any  guidelines  for  choosing  the  values  of  the 
scalars  A,B,C,  and  D  in  (4.11),  other  than  the  fact  that  they  must  be  positive 
and  much  greater  than  one.  It  is  desired  to  determine  relationships  between 
these  scalars  which  result  in  choosing  values  that  help  the  network  converge  to 
a  stable  state.  This  is  done  by  analyzing  the  network  at  steady  state. 

Suppose  there  is  a  square  t}  x  t)  matrix  of  neurons.  The  dynamics  of  a  single 
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neuron  in  the  matrix  are  given  by  (4.15)  and  (4.16): 


dxxi 

dt 

Vxi 


Y.  yyi-c(YZ^xi-i) 

j?ti  Y^X  X  } 

-^^<^xy(yy,i+i  +  VV,i-i)  (4.18) 

y 

g(xxi)-  (4.19) 


Now  approximate  the  input-output  relationship  of  the  neurons  by: 


V'a'. 


0  if  arA'i  <  -«o 

'  2  + 

1  if  xxi  >  Uo. 

\ 


Since  the  width  of  the  gain  curve  in  Figure  4.2  is  assumed  narrow,  this  approx¬ 
imation  is  not  unreasonable. 

Replacing  —xxi  in  (4.18)  with  the  approximation  2uo{\  -  Vv,),  and  setting 
it  equal  to  zero,  (4.18)  can  be  written  in  matrix  form  as: 


0  =  Ik  -  V -t- /IVL  +  RLV -1- CKVK  -  Ct?K -I- DdVS, 
where  L,  d,  K,  and  S  are  x  ?;  matrices  given  by: 


L  = 

0  1 

1  ••• 

...  1 

,d  = 

•  •  •  djyj 

,K  = 

1  . 

.  1 

1  ... 

1 

1  0 

dfji 

•  •  • 

1  . 

.  1 
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and 


After  some  algebra,  this  becomes 

2u^C7}K^^K  =  [(B-f-C)L-i-(C-l)IlV-i-[CL+iA  +  C)l]VL 

+Z?dVS, 


or  more  simply 


E  =  rV  + AVL+£>dVS,  (4.20) 


where  E  =  2u<,(Ci7  -  ^K,  A  =  CL  +  { A  +  C)I,  and  T  =  (B  +  C’)L  +  (C  -  1)1. 
The  matrix  A  is  nonsingular,  and  its  inverse  is  given  by 


where  a  = 


A'>+tiA’>-‘C 


Equation  (4.20)  can  then  be  written  as 


A-'E  =  A-‘rV  •  VL  +  DA-MVS.  (4.21) 
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Now  deRne  a  matrix  P  =  A  'F  as 


•<c-i)-<Kn-lKB  +  c) 


P  = 


C)-  #(C  -  J)_  #<1,  -  JXB  +  C) 


•(B  +  C)  -  *(0  -  1)  -  -  aXB  +  C) 


•(C-l)-*<,-JXB  +  C) 


If  the  off-diagoDal  elements  are  set  to  zero,  so  that 

£  =  (t7-2)(g-t-C)-KC-l) 

0  B  +  C 


(4.22) 


then  P=[a(C  —  1)  —  V’(’7  ~  1)(^  +  C')]I=£^I.  Equating  the  expression  for  tr  in 
A~^  with  the  expression  for  a  in  (4.22)  yields  the  following: 

—  =  -1.  (4.23) 

Using  this  relationship  gives  Q=1  + 

Equation  (4.21)  now  becomes 


A-*E  =  (?V  +  VL  +  PA->dVS 
=  V(gi  +  L)  +  £>A-*dVS, 


or  since  t?I  +  L  is  nonsingular. 


E(Ql+L)-‘  =  AV  +  dVS(gi  +  L)-'l>. 


Assuming  the  distance  matrix  d  is  nonsingular,  this  becomes 

d-‘E(<?I+L)-'  =  d-*AV  +  VS((?I  +  L)-'Z).  (4.24) 

Define  the  following  quantities: 

A  =  d“‘A 
B  =  S(QH-L)-'D 
C  =  d-*E(CI  +  L)-*. 
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So  (4.24)  becomes 


C  =  AV  +  VB.  (4.25) 

From  Bellm^  [3],  if  the  conditions  of  the  following  theorem  are  satisfied,  the 
solution  to  (4.25)  is  given  by 

V  =  -  r  e^^Ce^^dt.  (4.26) 

Jo 

Theorem  1  A  necessary  and  sufficient  condition  that  (4.25)  have  a  solution 
for  all  C  is  that  A,  +  /ij  0  where  A,-  are  the  characteristic  roots  of  A  and  pLj 
the  characteristic  roots  ofQ. 

The  characteristic  roots  of  the  matrices  A  and  B  must  be  calculated,  and 
the  values  of  the  scalars  A,B,C  and  D  adjusted  so  as  to  satisfy  the  relationship 
in  (4.25),  and  such  that  the  characteristic  roots  meet  the  requirements  of  the 
theorem.  In  order  to  do  this,  the  distance  matrix  d  must  be  defined.  This 
implies  that  the  scalars  are  dependent  on  the  values  of  the  elements  of  d,  which 
ultimately  depend  on  the  arrival  times  of  the  attackers.  This  suggests  that  the 
scalar  values  are  situation  dependent,  and  must  be  calculated  at  run  time. 
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Chapter  5 


Numerical  Results 


In  this  chapter,  the  results  of  applying  Algorithms  1,  2,  and  3,  and  the 
neural  network  to  several  attack  scenarios,  in  which  the  arrival  times  and  arrival 
angles  of  the  attackers  are  known  a  priori,  are  presented.  The  performance  of 
the  neural  network  under  a  deterministic  system  is  discussed.  In  the  determin¬ 
istic  formulation,  the  tracking  methods  of  all  the  attackers  are  assumed  to  be 
centroiding  {CEN).  In  the  Bayesian  formulation,  the  distribution  describing 
the  tracking  method  of  an  attacker  is  given  by 

Pr{a^lE)  =  .3 
Pr{Q  =  CEN)  =  .7. 
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It  was  assumed  that  the  defensive  resources  axe  inexhaustible.  It  was  also  as¬ 
sumed  that  no  updates  of  the  attackers  states  were  provided. 

A  total  of  nine  attack  scenarios  were  considered.  The  scenarios  include  situa¬ 
tions  in  which  one  of  the  decoy  types  has  a  higher  probability  of  success  against 
a  half  or  more  of  the  attackers  than  the  other  type,  and  also  include  arrival 
angles  for  which  the  decoy  type  with  the  highest  probability  of  survival  depends 
on  the  tracking  method  of  the  attacker.  The  specifics  of  the  scenarios  are  given 
in  Table  5.1.  The  ninth  attack  scenario  was  included  to  test  the  neural  net¬ 
work.  It  differs  from  the  eighth  in  the  spacing  of  the  arrival  times,  and  results 
in  an  increased  number  of  decision  instants,  which  in  turn  results  in  a  larger 
neuron  matrix.  The  probability  distribution  functions  describing  the  success  of 
the  countermeasures  are  given  in  Figures  5.1,  5.2,  and  5.3. 

In  all  nine  scenarios,  the  model  parameters  took  the  following  values: 


rA 

= 

16  miles 

va 

.2814  miles/sec 

A 

s: 

1  sec 

Ad 

= 

20  secs 

Ab 

— 

2  secs 

=: 

20  secs 

5= 

2.1  miles 

ro 

5  miles. 

Tables  5.2-5.10  give  the  optimal  allocation  schemes  determined  by  Algo¬ 
rithms  1,  2,  and  3  for  the  specific  attack  scenarios.  In  each  scheme,  the  decision 
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instants  at  which  the  “do  nothing”  control  was  the  only  feasible  control,  are  not 
shown. 

The  optimal  allocation  scheme  under  the  deterministic  formulation  in  Table 
1,  is  interpreted  as  follows:  at  the  first  decision  instant,  (time  -20  secs)  deploy 
one  decoy  of  type  R.  At  the  next  decision  instant  at  which  there  are  controls 
other  than  just  Z  feasible,  (time  0  secs)  deploy  another  decoy  of  type  R,  and 
so  on.  At  time  40  secs,  it  is  feasible  to  deploy  either  type  of  decoy,  or  “do 
nothing”.  The  “do  nothing”  control  is  applied  at  this  decision  instant  because 
the  attacker  has  reached  the  range  re,  and  since  deploying  either  decoy  has  a 
zero  probability  of  causing  the  attacker  to  transition  from  the  tracking  state 
into  the  not-tracking  state,  the  target  opts  to  “do  nothing”  rather  than  waste 
a  decoy.  At  time  50  secs,  the  attacker  is  in  range  of  the  hardkill  system,  and 
this  resource  is  allocated  every  2  secs  until  time  0=54  secs.  The  allocation 
schemes  in  the  minimax  and  Bayesian  formulations,  and  in  Tables  5.3-5.10  are 
interpreted  in  a  similar  manner. 

As  can  be  seen,  the  optimal  allocation  schemes  are  very  dependent  on  the 
specifics  of  the  attack  scenarios,  i.e.  the  arrival  times  and  the  arrival  angles 
of  the  attackers.  For  a  specific  scenario,  the  optimal  allocation  scheme  also 
depends  on  how  much  information  is  known  about  the  tracking  methods  of 
the  attackers.  As  expected,  the  probability  of  target  survival  drops  in  both 
the  minimax  formulation  and  the  Bayesian  formulation,  pau-ticularly  when  the 
number  of  attackers  is  greater  than  one. 

The  neural  network  was  applied  to  the  attack  scenarios  given  in  Table  5.1. 
The  network  was  run  87  times  for  each  scenario.  The  resulting  allocation 
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schemes  were  comp2U'ed  to  the  allocation  schemes  known  to  be  optimal  as  de¬ 
termined  by  Algorithm  1.  The  performance  of  the  network  is  presented  in  Table 
5.11. 

Several  observations  were  noted  about  the  behavior  of  the  network.  The 
network  was  very  sensitive  to  the  values  of  the  scalars  A,  B,  C,  and  D  in  (4.11), 
and  to  the  initial  values  of  the  neurons.  Small  changes  in  the  value  of  any  one 
of  these  parameters  led  to  entirely  different  output  matrices,  some  of  which  had 
elements  with  values  between  0  and  1.  Through  trial  and  error,  the  following 
values  of  A,  B,  C,  and  D,  and  the  external  input  currents  resulted  in  the  elements 
of  the  output  matrices  taking  values  of  either  0  or  1 ,  and  were  the  values  used 
in  each  run  of  the  network: 

A  =  400  B  =  800  C  =  200  D  =  500 
Ixi  =  C{K  +  5). 

In  each  of  the  runs,  the  network  started  from  a  different  random  initial  state. 
From  Wilson  and  Pawley  [4],  the  initial  condition  of  each  neuron  was  calculated 
using  the  following: 

Vxi  =  ^(1 +tanh(^^)) 

2  Uo 

Xin,i  =  -|iln(/r-l)  +  ^. 

where  Uo=-02,  and  ^  is  a  uniformly  distributed  random  variable  on  the  interval 

[  .1  »•  1  Iinit] . 

Whether  or  not  the  network  converged  to  a  valid  allocation  scheme  depended 
solely  on  the  initial  values  of  the  neurons.  The  invalid  schemes  were  character¬ 
ized  by  column  errors,  in  which  more  than  one  1  appeared  in  a  column,  or  no 
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I’s  appeared.  This  is  interpreted  as  the  scheme  allocating  more  than  one  re¬ 
source  simultaneously  at  the  decision  instant  corresponding  to  the  column,  or 
allocating  no  resource  at  the  decision  instant. 

In  the  majority  of  the  invalid  schemes,  or  the  schemes  that  were  valid  but  not 
optimal,  segments  of  the  schemes  were  optimal,  but  the  entire  scheme  was  either 
not  valid  or  globally  optimal.  For  instance,  several  schemes  gave  the  optimaJ 
decoy  deploying  sequence,  but  an  invalid  or  suboptimail  hardkill  sequence,  and 
vice  versa. 

It  is  observed,  that  w’hen  the  number  of  attackers  was  greater  than  one, 
the  percentage  of  valid  schemes  decreased  to  zero.  In  the  majority  of  these 
situations,  the  network  resulted  in  schemes  in  which  the  hardkill  sequences  were 
optimal,  but  at  the  decision  instants  at  which  decoys  were  feasible,  both  decoy 
types  were  allocated. 

These  results  do  not  show  to  what  degree  the  size  of  the  network  affects  its 
performance. 

One  last  note,  when  all  of  the  neurons  in  the  network  were  allowed  to  vary, 
the  schemes  the  network  converged  to  were  never  V2did,  and  exhibited  almost  no 
local  optimality.  When  the  output  of  certain  neurons  were  fixed,  as  described  in 
Section  4.1.1.,  the  network  began  to  yield  valid  and  sometimes  optimal  allocation 
schemes,  and  when  not  valid  the  schemes  often  had  optimal  segments. 
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Attack 

situation 

1 

(60®,0sec) 

54sec 

2 

(180",0) 

54 

3 

(30‘»,0) 

54 

4 

(60‘»,0),(120",2) 

54 

5 

(30‘»,0),(1S0",4) 

58 

6 

(110%0),(180“,4) 

58 

7 

(20»,0),(50%2),(50“,4) 

56 

8 

(30%0),(60»,2),(140»,4) 

56 

9 

(30%0),(60%4),(140%6) 
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Table  5.1:  Attack  scenarios. 


Formulation 

^opt 

Probability  of 

target  survival 

Deterministic 

RRRZG\G\ 

.91 

Minimaix 

RRRZG^G, 

.89 

Bayesian 

RRRZGiGi 

.90 

Table  5.2:  Attack  scenario  i^\. 


65 


Formulation 

^opt 

Probability  of 

target  survival 

Deterministic 

LLLZGiGi 

.80 

Minimax 

RRRZGi  Gi 

.19 

Bayesian 

LLLZGrGi 

.75 

Table  5.3;  Attack  scenario  ^^^2. 


Formulation 

! 

Probability  of 

target  survival 

Deterministic 

RRRZGiGi 

.94 

Minimax 

RRRZGiGi 

.93 

Bayesian 

RRRZGtGi 

.93 

Table  5.4:  Attack  scenario  #3. 


Formulation 

^Opt 

Probability  of 

target  survival 

Deterministic 

LRRZG\  G2 

.56 

Minimax 

RLRZGxG^ 

.46 

Bayesian 

LRRZG\  G2 

.51 

Table  5.5:  .\ttack  scenario  #4. 
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Formulation 


Probability  of 

Formulation 

^opt 

target  survival 

Deterministic 

LLLZGi  GiGjG^ 

.59 

Minimax 

RRRZG\  GiG^G^ 

.18 

Bayesian 

ZiLLZGiGiG^Gj 

.46 

Table  5.6;  Attack  scenario  #5. 


Formulation 

1 

^0pt 

1 

Probability  of 

tairget  survival 

Deterministic 

LLLZGi  G1G2G2 

.51 

Minimax 

RRRZG1G1G2G2 

.04 

Bayesian 

LLLZGi  Gi  G2G2 

.40 

Table  5.7:  Attack  scenario  #6. 


Formulation 

^opt 

Probability  of 

target  survival 

Deterministic 

RRRZGj  G2G3 

.70 

Minimax 

RRRZG1G2G2 

.63 

Bayesian 

RRRZG1G2G3 

.67 

Table  5.8:  Attack  scenario  #7. 
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Formulation 

Probability  of 

target  survival 

Deterministic 

.56 

Minimax 

RRRZG\  G2G3 

.46 

Bayesian 

.52 

Table  5.9:  Attack  scenario  ^8. 


Formulation 

Wopi 

Probability  of 

target  survival 

Deterministic 

RRRZGi  G1C2G2G3G3 

.56 

Minimax 

RRRZG\  G1G2G2  G3G3 

.5 

Bayesian 

RRRZGi  G\G2G2G3G3 

.57 

Table  5.10:  Attack  scenario  #9. 
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Attack 

situation 

Network 

size 

Valid  schemes 

found 

Optima]  schemes 

found 

1 

13x5 

21 

5 

2 

13x5 

72 

30 

3 

13x5 

9 

1 

4 

13x5 

0 

0 

5 

17x7 

0 

0 

6 

17x7 

0 

0 

7 

15x6 

0 

0 

8 

15x6 

0 

0 

9 

23x9 

0 

0 

Table  5.11:  Performance  of  the  neural  net. 
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Probability  of  success 


0 


50  200  250  300  350 

Arrival  angle  0| 


Probability  of  success 


Figure  5.2:  Probability  of  success  of  decoys  with  a  =  CEN 
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Range  from  the  target  (miles) 


Probability  of  success 
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Conclusion 


Algorithms  1,  2,  and  3  are  easily  implementable,  and  require  less  computation 
to  determine  the  optimal  allocation  schemes  than  their  exhaustive  search  coun¬ 
terparts.  The  resulting  schemes  are  totally  dependent  on  the  attack  scenario, 
and  the  amount  of  a  priori  information  available  about  the  tracking  methods  of 
the  attackers. 

The  model  becomes  more  complex  as  the  assumptions  are  removed.  Relaxing 
the  assumption  that  the  target  is  stationary  greatly  affects  the  probability  of 
target  survival  by  making  it  a  continuous  function  of  time.  As  explained  in 
the  Introduction,  one  parameter  the  probability  of  success  of  a  countermeasure 
depends  on,  and  thus  the  probability  of  target  survival,  is  the  physical  location 
of  the  attacker  relative  to  the  target.  Permitting  the  target  to  move  therefore 
results  in  time- varying  The  values  of  the  cannot  be  predicted  unless 
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the  trajectory  of  the  target  is  known. 

Allowing  the  target  to  move  can  be  considered  a  countermeasure.  If  the 
angle  of  an  attacker  is  such  that  the  probabilities  of  success  of  the  decoys  or  the 
hsirdkill  system  are  very  low,  the  target  may  move  and  turn,  so  that  the  attacker 
ends  up  in  a  position  relative  to  the  target  for  which  the  probability  of  success 
at  least  one  of  the  countermeasures  is  higher.  However  by  doing  this,  the  target 
may  have  made  itself  more  vulnerable  to  other  attackers,  present  or  future;  and 
ma  also  have  excluded  certain  countermeasures  from  being  currently  feasible. 
If  the  arrival  times  and  arrival  angles  of  the  attackers  are  known  a  priori,  the 
target  can  plan  its  trajectory  and  determine  an  allocation  scheme  so  that  its 
probability  of  survival  is  the  highest. 

Relaxing  the  assumption  that  there  is  only  one  attacker  type  complicates  the 
model  only  if  the  attacker  types  are  unknown,  and  there  are  countermeasures 
which  are  only  affective  on  certain  attacker  types. 

Also  the  issue  of  constrained  resources  was  not  addressed.  Reformulating  the 
model  to  allow  a  mobile  target,  and  developing  algorithms  for  determining  the 
optimal  allocation  schemes  in  each  of  the  three  formulations,  particularly  when 
the  arrival  times  are  not  known  a  priori,  and  there  is  a  constrained  number  of 
resources,  is  a  possible  consideration  for  future  research. 

Although  fixing  the  output  of  certain  neurons  drastically  improved  the  per¬ 
formance  of  the  network,  the  neural  network  does  not  appear  to  be  a  reliable 
means  of  determining  optimal  allocation  schemes.  In  the  case  of  a  single  at¬ 
tacker,  the  network  converged  to  vadid  schemes  in  39%  of  the  runs,  and  to  the 
optimal  allocation  scheme  in  14%  of  the  runs.  In  all  cases  of  two  or  more  at- 
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tackers,  no  valid  allocation  schemes  were  determined,  however  long  segments  of 
the  schemes  were  frequently  optimal.  The  errors  in  the  invalid  schemes  were 
typically  the  allocation  of  both  decoy  types  at  a  decision  instant  at  which  de¬ 
coys  were  feasible,  (column  error).  The  attackers  seem  to  be  “competing”  for 
the  decoy  that  is  least  likely  to  succeed  against  him.  This  results  in  an  invalid 
scheme. 

However,  the  fact  that  the  network  does  sometimes  find  the  optimal  alloca¬ 
tion  scheme,  and  that  it  tends  to  locally  optimize,  suggests  simulated  annealing 
as  a  way  of  using  the  neural  network  to  find  the  optimal  allocation  schemes. 

For  the  minimax  and  Bayesian  formulations,  and  when  arrival  states  of  the 
attackers  are  not  known  a  priori,  it  is  not  clear  how  to  construct  the  network 
to  find  the  optimal  allocation  schemes.  In  the  Bayesian  formulation  and  the 
unknown  arrivals  case,  the  cost  function  is  a  weighted  sxim  of  products.  If  one 
network  is  to  be  used,  it  is  uncertain  how  to  bound  the  cost  function,  and 
calculate  a  distance  matrix  that  reflects  the  weights  in  the  sum;  or  if  several 
networks  are  to  be  used,  it  is  uncertain  how  to  link  them  together. 

The  method  described  in  Section  4.2  was  not  used  to  choose  the  values  of 
the  scalars  A,B,C,  and  D  in  (4.11).  This  method  assumes  a  square  neuron 
matrix,  and  the  neuron  matrix  in  the  network  developed  in  Chapter  4  was  not 
square.  However  the  analysis  was  helpful  in  giving  a  little  more  insight  as  to  the 
behavior  of  the  network.  The  same  set  of  scalar  values  led  to  stable  networks 
in  the  nine  scenarios  considered.  This  suggests  that  it  is  only  required  that 
relationships  in  the  form  of  inequalities  between  the  scalars  be  met.  This  seems 
plausible  since  for  (4.25)  to  have  a  solution.  Theorem  1  only  requires  that  none 
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of  the  cross  sums  of  the  eigenvalues  of  the  matrices  A  and  B  equal  zero.  The 
exact  inequalities  that  must  be  satisfied,  depend  on  the  values  of  the  elements 
of  the  distance  matrix  d,  which  explains  why  cert2un  values  of  the  scalars  result 
in  an  unstable  network. 
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Appendix  A 

Energy  Function  Describing 
Neural  Network 


The  derivation  of  the  expression  in  (4.11)  from  the  expression  in  (4.12)  using 
the  eouations  in  (4.13)  and  (4.14)  is  given.  The  equations  in  (4.13)  and  (4.14) 
are  repeated  below  for  convenience: 

hi  =  CK 

Txi,Yj  =  -ASxriy  -  iff)  -  -  Sxy)  -  C 


< 


-Ddxri^iMi  +  ^i.i-i) 

1  ift  =  > 

0  otherwise. 


(A.l) 


From  (4.11), 


Txi^YjVxiVyj  -  ^J^Vxihi-  (A. 2) 

^  X  Y  i  3  X  i 
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Substituting  (A.l)  into  (A. 2)  gives  (4.11), 

=  ~9  ~  -  dxv) 

^  X  Y  i  i 

-C  -  DdxY{6i,i^x  +  6,,i.x)]VxiVY,  -  5;  52  ^xJxi 

X  I 

=  9!^  H  ^xiVxj  +  ^  51  ^xiVYi 

^  X  I  i^i  X  Y^X  i 

+c’EEEZ'<^.Wi  +  /)E  E  E‘^^>'Vx.(Vy,+,  +  %-i)] 

X  Y  i  i  X  Y^X  i 

X  i 

=  4  E  E  E  ^xiVxi  +  ^  E  E  E  ^xiVn 

^  X  i  j^i  ^  X  Yi^x  i 

^  X  <  ^ 

^tE  E  ^^XYVxi{yY,i-H  +  VY,i-l)- 

^  X  Y^X  i 

The  equation  describing  the  dynamics  of  each  neuron  given  in  (4.15)  is  de¬ 
rived  from  (4.3)  using  the  equations  (A.l). 

=  ~  ^0)  -  ■®^i>(l  -  dxY)  -  c 

KL  Y  j 

-DdxY{^},i+i  +  ^i,i-\)]^Yj  +  CK 

Vjtx  Y  3 

—D^dxY{VY,i+i  +  '^v.i-i) 

Y 

=  -^-AY:Vx,-B'£.Vy>-C(i:.T.Vy,-K) 

VjtX  Y  3 

-D^dxYiVy  .•+1  +  VY,i,x). 
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